There is an error when building the garden upgrades and you are waiting them to finish. If you sleep with someone, it doesn't count as a day passed and the updates will never end. You've to sleep alone or sneak around for the updates to complete.
