That's annoying. What device were you playing on? I did test it mostly only on PC.
Were you able to input a colour to begin with? You can turn off any input colours by bumping into them again, which would let you input a colour in another spot.