That's a strange issue, I've tried with so many controllers 😂 have you tried something like https://hardwaretester.com/gamepad?
This is all completely valid feedback and stuff I've been thinking about too. I think to me (and I assume robin), the progression is intended to be more skill based - obvious much more balancing required, it all kinda came together with a couple of hours to go 😂 but in theory, the level presents more of a skill challenge as more and more obstacles get added, but you get more tools to deal with them as you upgrade things.
You go faster by being more careful because your engine cuts out when you get hit! The aim of the game is not just to ram your way through, you're supposed to get better at avoiding things and play more skillfully. Again though time and balance needed to really nail that goal from a design perspective!