Tried the game again to see if anything was fixed. Needless to say... It's far worse than it was before.
I'm pretty sure that you could easily fix most of the problems by not using hand gestures at all, you clearly have zero skills at figuring out how to get them to work properly within the game. Just add the actual controllers into the game, or at least an option to use them instead.
Otherwise this whole game is just a complete scam.