The structures in the picture with the yellow arrows look like they are the ports. There is a boat pulled up on one of the ones that doesn't have an arrow on it. You can also see a buttons to deploy ships or the whole Navy in the UI.
