I didn't stack All of them, I just kinda used one when I needed a little power bump for the next level. Then as I got towards like level 8 I sold them all.
I'm not a game balancing expert, so my suggestion on a fix wouldn't really be worth much. But at least at first glance, not upgrading scrolls with scrolls as you mentioned below seems like it would work at least. Although the guy below's suggestion sounds pretty interesting too, pending some number crunching investigation probably.

