Thanks for letting me know, I wasn't able to test with an xbox controller (don't have one), but it might be if you're using the analog stick rather than d-pad?
The controllers I know it works with for sure are-
+Playstation 3 and up controllers
+Switch Controllers
+8Bitdo Controllers