Would be awesome, I've thought of making a game like this where your art becomes apart of the game, but I have no idea how to even start with something like that :) You're on to something with this, keep going with it :)
Will do!! by the way if you are interested in the gesture recognition, I have used original $1 code and created my own slightly transformed implementation in Unity, there are certainly lots of ways to improve it tho :)