I don't know, for me it's just muscle memory to press Esc for the pause menu. But you don't really need to.
But I have this bug, everytime I want to play the second level it shows me the Game Over menu. When I'm pressing Restart it just keeps showing. I tried to restart the game and it's the same.