Same. I've been struggling too.
try walking around the world map
There's only the cave, forest, temple, town, and tower right?