would it be possible making a second field to determine brightness?

Real-time image-driven color simulation, Daltonization & enhancement for the entire screen. · By
Currently you can only adjust the hue component of HSV colors. You can transform any hue into any color you want, but the hues will always converge to the same normal trichromatic white and black. I.e. saturation and brightness are constant colors.
Adjusting any color of the full digital 3D color space is actually not easy, and I won't add such a functionality to Custom Color Vision. But I'm working on another program that can do exactly that. So stay tuned.