They are considered an "underlayer". You will find a person who can help you unequip them a bit later in the game, but you MAY need to remove other things before they can remove underlayers.
