Indeed! Maybe a couple points of affection just to establish a basic friendship too. Mostly trust tho.
The story does seem to be written with the assumption that the player is romancing all of the girls though, as much as possible.
My strategy of only romancing a few at a time is also about leaving content for myself to enjoy later though.