That's probably because it's behind the magical barrier in the desert and you need to progress the main quest to lift it.
