I think I narrowed this down to an issue with my mouse in-browser. It's not happening when I press "ESC", which un-captures my mouse. -p but that leads to other problems. Not sure. Seems like it's not an issue with your game though.
