i think the issue is my mouse claiming to be a controller because it can do some macro stuff for that, I've found a workaround which is essentially just revoking and restoring my access rights to the device node before/after playing it with a script.