I'm not exactly sure what you mean, but to find the pirates you need to walk all the way north of Sablee, then into the ocean!
Here is the walkthrough if that helps: https://www.patreon.com/posts/119207938)
