That's really weird! I just tested it with both a 360 and an Xbox One controller and it doesn't happen to me. Are you using any kind of controller app that might be getting in the way?
