So digging a little deeper into this, looks like other people have run into similar problems with other Unity games. It looks like on Windows Unity stores player preferences in the registry... which seems asinine to me. I don't know how comfortable you are with editing the registry but it appears you'll have to go in there and either edit it or just delete the keys related to input from there then just restart the player:
"On Windows, PlayerPrefs are stored in the registry under HKCU\Software\[company name]\[product name] key, where company and product names are the names set up in Project Settings."
I'm incredibly sorry for the inconvenience.