Yep, some things were a little janky; I was using Godot 4 (main branch daily build). The old XR Tools had some strange movement controls, but the new beta 3 fixes a lot of those things. Since the submission of the jam I have made some improvements but will re-upload in a few days to fix some of the more glaring bugs.
There's nothing to be done at the alter right now. I was supposed to have that as a second puzzle but didn't have time to finish.