Its not very well indicated, but you can actually upgrade all the weapons. There are arrows you can click to switch the upgrade list.
