There is a building next to the castle on top of Milhaven, it's close to a square with a fountain. You need to go to the side entrance of that building, where the lights are purple crystals