I was playing in Windows, there was no controller connected either so I ruled out that issue. Seemed strange, because I only usually see that type of issue with analog controllers. I did try restarting the game a couple of times but the issue persisted.