Go left and see the ferryman. You need to be far enough in the story though (when the map hint shows up, you're good.).