There is an issue you might have ran into where even briefly sweeping a flag too close to kobolds makes them remember it as a flag to ignore.
As far as colors go, they are purely decorative - kobold type is determined by what they are carrying, though I should have communicated that in the tutorial. Glad you gave it a shot regardless!