I don't know what to do in the castle

Throw Spear at button.

if you have not unlocked spear, go get molested by the zebras.