There's a bug where I keep moving to the side. I think it might be controller related, but, I'm not sure. When unplug it, it still seems bugged. It would be cool to have controller support, maybe that will fix it.
I had the same issue. Restarting the game after unplugging the controller solves it!
