Okay, I realized you have to click the number of the quickslot to equip the gun. Which doesn't really help, since after two shots it's stuck forever.
