There is another building in the Desert, where you fight a boss before going to the next area.
This map has vertical and horizontal loops like some JRPGs' world maps, but you can use objects scattered there to see when you have walked an entire loop.