Ok, I think I got it. Basically the issue happens when I enable, disable and re-enable the STM.
The registering of the font rebuild happens on Start and not on OnEnable but the unregistering happens OnDisable. So basically my STMs never re-register again after being re-enabled.
Is there a reason why it is not symmetrical between OnEnable and OnDisable?