You could do it so you complete all the levels before the controls become more delayed? So you play 1-2-3, go up 10 frames delay 1-2-3 ect....
Like how the tiles were used.
The progression gets more frustrating then fun past a certain point but it's a neat idea. The sleepy sadness of the song does fit it oddly well.
