The new version didn't fix it but I used the recenter in steamVR and that fixed it. I tested original version and recentering also fixed it. I should have tried to start with but I don't think I ever had use that feature. I'm not sure if the issue is the game or my janky Pimax/index setup.
Anyways, this game plays really well! Super fun flying around and doing the time trials. Great work!