Blue is friendship points - I had a line of them at the top of his love heart, and I freaked out thinking it meant he was losing affection. But we went on to become happy lovers, so you'll probably be fine if it's just at the top. I noticed right after I'd been doing a lot more working at his mansion than taking him on dates or talking to him elsewhere, so that might have something to do with it. :)