By default material colors should be saved on the material instead of being baked into the vertex color, you can set it to white in the Materials settings (should be able to multi-select models if there are a lot of them), is that what you’re looking for?
If the color is baked into the vertex color - there’s a setting to do that but it should be off by default - there’s also a “Reset Vertex Color” under “More…”