Definitely an interesting idea and a cool demo. If you fleshed this out further, I bet it could be really fun!
