I was just using a keyboard and mouse. If I click Settings after starting the game, I can't leave the Settings screen. Hitting ESC no longer works.
Edit: Oh, I see that I can back out by hitting B. I was confused because you can hit ESC to exit Settings at the Main Menu.