You can weaken crests by using Mantras from the Mental Ward. It will diminish all crests except one.
But yeah, the game can be difficult in the beginning. Though you'll get used to it, most veteran players find it too easy instead :)