Tiny fix; I’ve made a new version now where you can hold left ctrl and drag. This should not register as typing :D
Yup, now it works! :)