Redownloaded, unpacked and the bug is gone. I did try to run the game several times before (like 5 times) and it had the control bug every single time.
It's still kinda erratic, if you click empty spot (without UI element) with a mouse then it disables the controller and keyboard inputs until you highlight some element. It's so weird, I guess UI layers are messed up.