I think that's implemented in the game and im playing at the stable version 0.9.8.5 the day passes like normal through entering and exiting the goblin cave, its kinda make sense since the way is veeeeerrry very long and Lona needs to travel that shit her way through the mountain caves