I'd say it's because of the large differences in weight/speed the dice. So for example the blue and green dice both feel really heavy and kind of slow, while the other ones send you flying without much warning or buildup
