Yeah sometimes the calibration and tracking is wonky. Especially if you move your head, but part of that is the challenge in the game.
