I'm unsure how far you've made it into the game but yes, as it mentions some of the girls gain affection from some personality choices. I believe you can also see who they 'prefer' in the Character Menu by clicking the On/Off button in the bottom right.