Don't know if it's a bug or a game feature but my bullet upgrades will just disappear while I advance. I'll get an upgrade going from 2 shots to 3 shots and then the very next stage I'm back down to either 2 shots or 1 shot.
nvm, figured out that purple upgrades are temp.