You are getting points for originality, but even though I like the idea of an unconventional control-scheme this was slightly too frustrating to keep me engaged.
A few simple sound effects would have gone a long way also, but other than that, you had some good visual polish :)