After some investigation, there was definitely a bug with keyboard input!
Sorry about that -- it took some tinkering for me to replicate the problem. I've uploaded a new version which should be fully playable on keyboard now (though gamepad is strongly recommended if you have access to one)
Thanks for pointing this out!