I think just some general markers, some kind of unison visual map element, would improve it a lot, and perhaps something early to inform you that it is more Yume Nikki than clearcut progression. Went around for about 40 min in total, going in and out of the different houses, exploring south and east, the writing is cool and there a huge amount of great visuals.
I think letting players more easily access these elements will only do your game good.