Because trashies don't recharge when not in your hotbar, I think it makes sense for you to be able to reselect whenever you want, because you still have to choose what you want to be coming off cooldown as soon as possible for your defense.