You might have missed my "go-to" explanation down below, or maybe pictures are just always best! Here's some pictures just in case it helps more. As you can see, the last image down below has Ban now outside at night, after clicking on the town map. From there you can pick where you want to go. Hope this helps! 
