After you go past the Troll that was guarding the bridge (One of the choice allows you to not be stopped there if you give him about 100 Gold or so to him), you should be able to reach it as one of the 2 locations you can go to after the secen with Jester in your home.
