Nice concept! I can see this being fleshed out into a full puzzle story, or handling players and NPCs, etc!
I will definitly try to flesh this game out. I have many ideas and plans.