Yep, the mouse is intentionally hidden when there isn't anything on screen that you can click on. It only appears for UI screens.
