You go to the dock in the top left at Havaria Port, where the sign says "Dock 3 - Ships to Dorgania," and talk with the dock worker next to it. Select "Wait for the ship." in the choice to trigger the ship journey.
I feel dumb. I just kept going to the one to the south end of the docks
