Nice concept! Had my fun with it.
I also found it a bit inconvenient with the right hand. Maybe an idea would be to also start the level with Space instead of the Enter key. Then one does not need to jump the buttons. (But that would require to keep track of the game state to decide whether to place the ladder or to only start the level)