Did you EXAM the map on the floor first to identify it? That triggers the new path in the desert allowing you to travel there
Finally found it, thanks. I seemed to have been reading the map incorrectly, I had to follow it literally to get to my destination. The game's positioning of the character threw me off by 1 square.