I really liked the concept and see a lot of potential in what you've done. There is no denying that the game is fairly original in it's mechanics! However, I think the mastery of the controls had less to do with the concept and more to do with some mouse differences across the board. Maybe locking the cursor and focusing the game? I have two monitors so even when playing in full screen I was able to click out and ended up having latency from larger mouse moves.
Honestly, it is a really cool idea and art style!