Thanks for the detailed notes!
The calibration doesn't happen on the first level because it doesn't change the height or distance. But yeah I guess if you aren't centered properly then it can still be necessary.
The babies is probably the most janky - yes you do kind of need to be looking right in the center for it to trigger, which is simply a consequence of how camera-based tracking works (if the cameras can't see the controllers, then it will lose tracking).
Thanks for playing!