I think the core mechanic is a lot of fun - the difficulty spike on level 9 is really harsh, though, unless I missed something. There definitely is a lot of fun to be had with this, and it could be expanded upon. Good work!
As a side note: It did not make it less enjoyable for me, but clicking "scores" completely froze the game for me, to the point I had to kill the task.