Oh, I actually didn't come to think that - so not really a bug then. When the cursor is outside the level area, it works fine if you play with just keyboard.
I still considered this a bug, and fixed it. The mouse will be ignored as long as it doesn't move, so it doesn't re-trigger when it's untouched. Should work more intuitively now! Thanks for the report.
