Tested some more. I got an XBox360 controller to work if it was assigned to Control #4.
Haven't tested extensively though but it seems that they don't work if they are assigned to Control #0-Control#3.
The issue with only being able to use 4 XBox360 controllers remains.