I honestly don't entirely understand the mechanics of the game entirely and it seems a bit buggy.
You seem to have a very original idea so I say stick with it! Some sounds and a tutorial (or other introduction if there is a theme of ambiguity) would take it a long way.