I think there should be penalties for everyone under the maximum rating count, but it should be logarithmic in some sense. So if the top game has 200 ratings games with 100 ratings receive a -1% penalty, 50 ratings receive -2%, 25 ratings receive -4%, 12 ratings receive -8%, and so on. Something like that.