The design of the permanent perks is meant to be both a challenge to get enough points to earn them, but also that you would very likely rebirth right after to "get your points back" so they can be spent elsewhere.
So when you say you don't take time to appreciate it, it's not really intended to be used in the run that you earn it. Probably best to either do a push run or a permanent perk run, but not try to do both. So rebirth away and reap those benefits!