Are you playing in browser? There the controller support is not great due to a unity bug. I'll look into it again and maybe try a workaround
