I figured that's what had happened.
Hmm, well as a part-way solution, how about make it that pressing a mouse button and moving the mouse upwards is the same as not pressing the button and moving it downwards?
