Ah, that's because the effect is actually equal to prestige point^0.43. Meaning they double every time prestige grows by 5 times. Otherwise it's going to grow too fast (prestige is already a bit too fast).
