The gems don't seem to be respawning/getting counted on subsequent playthroughs.
Huh, how'd i miss that?
should be fixed now, thanks for pointing it out :)