That is a really original idea, I like it a lot!
While I would not be able to read some of those number by color alone, it seems like the dots used to represent the number always end up smaller than the background ones, which makes it easier to tell the number anyway.