I really like the concept of this, even though it is only a small portion of what you were attempting. You're right that it was very ambitious for a weekend game jam, but sometimes you need a jam to get started on something that you otherwise might never have attempted. I hope to see you continue development of it, I always enjoy seeing games that are totally different and break the norms :)