Once you've picked up the shotgun, pressing "F" (or "K" for left-handed controls) will put down the lantern and equip the shotgun. To pick the lantern up again, just interact with it.
