I really liked the concept, I wish that there was just some progression!
I didn't enjoy the game itself because I couldn't feel that I was winning or losing at any point, there was no progression, it was more like an interactive art piece than a game for me. Now who's to tell you that an interactive art piece is not a game? Not me :D
Also I feel like your game is a very nice twist on the limitation!
By the way, was it intentional that the appearance of the controlled character matches the surroundings?