I have a feeling this might have to do with the "Multi Material UI" bool? Make sure it's checked/unchecked to test this.