I forgot to mention this during the game, but if you open the pause menu with the escape key there should be a button to retry and return to the menu.
