Calibrate your controller, or unplug your mouse.
still happens with no controller/mouse plugged in. plus if that was the cause of the issue id expect to see the same thing happen in other games but thats not the case. something else weird is going on
Good luck finding your issue! I use a wired Xbox 360 controller and wired Apple Mighty Mouse and have no problems.