Thanks you for your Feedback!
Well the Problem is, I generate these textures at runtime so there are no actual assests and I didn't find a way to disable compression for Texture2d in time (I think you could use a Rendertexture instead). A better solution i can think of is probably to just create a 2 dimensional array to store the colors and then copy them over.