This is a bug, but also working as intended in a way. You can't remove weapons, only replace them, so when you unequip the yoke it unequips it and replaces it with the default weapon of the class (another yoke).
Ahhh -- I see. Thank you. I am enjoying the game so far. Keep up the good work.
