Pretty fun idea and clean execution! But the delay on moving with the mouse button feels too sticky, like my input isn't being read.
I didn't quite understand what is the problem your having. But to my understanding you didn't move with WASD or the arrows keys, I believe if you will try again you will have a better time, I recommend you to read the description for full controls.
OMG I didn't know you could move with WASD I'm sorry I'm a lil stoopid, That makes so much more sense LMAO