This happens if a controller is plugged in but isn't being used. You need to unplug it and restart the game.
There is not controller plugged in, however, it seemed to be a driver problem. I disabled everything labeled game controller in device manager and that fixed the problem. It seems to be a common Unity problem.
P.S. Highly enjoyed the game, keep up the fantastic work.