Yeah, the heart drops replenish some health, but it's a small amount, so it's easy to miss. Once you become stronger, more hearts drop and their effects become more substantial.
So far this mechanic is not very fleshed out, it definitely needs more work.