The ML model does recognize colors, but it's not gonna return it. It only returns the probability of how close x drawing is to each data in the data set you've trained the model with. If you trained the model with black colored shapes, and the player draws with a red pen, then the probabilities are gonna be off.