For the life of me I cannot open the cave south of the city...Does it have something to do with the lever in the dungeon, that 'locks you in'?
That one is a bit tricky, you can actually open it at the very beginning. You need to use an ability explained in the 'How to play' sign in front of Vuu's house.