I believe Bernard is the only one with 4 so far. Not much changes besides him being more affectionate in dialogue and 4 hearts with him can unlock a 3way with Caleb.