If I ever were to try and find Acacia's Den's Coordinates, then I'd preferrably know her sleeping habits beforehand!
If memory serves me right, there is nothing at all on the map that indicates that there's any kind of civilization down to the south. Although it's been quite some time since I last willingly went down there to explore, so who knows. I think it's just in-universe lore as for now, just like with Thalassar at the end of the road to the right of Silverpine.