It has been a while since I last played this, but I still remember why I stopped. There was this household event where I missed some dialogue option due to lack of progress with certain girls, because I focused too much on side content. I don't think these household events can be postponed, so if you want to unlock as many scenes as possible, then you can't really mess around too much.