You can only switch towers by resetting your layout with prestige. Once you choose you're locked in for that run.
