you have to use the offer mechanic. If you are on mouse and keyboard you hold the hat and press "E" to extend your hand with it. Do the same gesture in VR. The game is in early stages and this offering system will be improved later. Currently it is only for the RIGHT hand.