You're right! Maybe you can add the instruction to click the copies of the players to switch the player. I have read the comments on the game jam submission page mentioning switching the copies of the players but I only tried pressing random keys and did not try mouse button.