Make sure you put a 'pause = false;' when you use the Return key to return to the game, otherwise you'll have to hit Esc twice in order to pause again!
Came to the comments here to find the fix for this exact thing. Thanks alot.
