Thank you for trying out the game. Yes, the movement might feel weird sometimes, since it's relative to your playspace direction. If you get put back into the chair and decide to rotate around yourself, instead of recentering ingame, the movement will start to feel that way.
I haven't put more time into this project anymore to figure out a fix for it. Basically recentering ingame while sitting the same direction as you sat down and started the game should get you further for now.