You need to go through the castle.
Is this the castle you were talking about?
no, it's the one one the island with only the broken bridge connected by a cave, also how did you get the top left scene