You can't just drop them. If you want to change the main weapon, grab it from the forearm with your other hand and take a weapon you want to be the main one. You can also use a weapon mixer station (orange room, the device in the middle) and leave a weapon there.
