after a certain questline is finished you can just walk through to the areas over there ignoring the caves. I think it's the orc war one where you fight an important character I'd rather not mention as it's a possible spoiler.
