Yes, this is badly explained in my data as taking scrolls yealds no points.
9 scrolls total = 5 random on map + 2 chests + 2 from lovers.
In a “Max stamp run” the max scrolls leavs you with 7 scrolls as you can’t kill the lovers.