I think I just encountered a bug. I had the game open on the game over screen for a while and when I came back each match removed a few seconds from the timer instead of adding a few seconds (so I got game overs really quickly). Haven't gotten it to happen again, though.