You're right, but the speed doesn't increase over the game. I wanted to keep it fast and nervous, I find that after a couple of tries you start to get a lot more precise with it, until a point where you feel almost comfortable with the speed.
I would have made it so that the game is slower at first but the jam wouldn't allow the extra complexity in the code I'm afraid. Maybe for a future version!