castle you mean after manor quest or after you got all orbs ?
after manor quest, you need to use the headband and change back to turn it into an equipable item
