Seems like a great concept!
The only thing I'd change would be the restarting (maybe try restarting each level, instead of the whole game, because it gets very irritating very fast).
