I agree with that rule. In solo with OSE, I often didn't roll the damage and went with the average. It speeds up play a little but your method add surprises (low score)!
