I think I found out why my approach probably lead to this problem. I didn't use texture atlas for my icons. I bundled up some icons into a texture atlas now and that way I am not limited to 7 different ones.
I assume this is some sub-mesh or sub-material problem?
It's better practice to use texture-atlas anyways so I will just set it up that way. Still an interesting find, no? 😅