Firstly, you need to go back and talk to Ofsy/Rashi if you haven't already. After that, at the bottom of the old palace you should see a set of stairs, and if you go straight down from there you'll find your way out.
