I like the idea. I managed to get to level 3, but the mouse clicking felt too imprecise. (Little hack: you can stop the time by clicking outside the window, which might help in some tight spots)
