Alright, the curse is lifted! I never would have figured that out on my own, I kept sailing north of the peninsula and trying to dig on islands cause the NPCs made it sound like the library would be farther out into the ocean. None of the grass on the peninsula really looked suspicious to me.