Are you stuck on the first screen? If you are you can jump and then exit through the right to start the game. If you're stuck on the death screen it might be a bug I'm unaware of.
Tried it now again. I am just a moron and didn't try the arrow keys.