They do serve as a sorting factor, however to prevent the case of most sites that promote what is already popular, new content is more important on the front page.
The points are also a reward for engagement on the site. Most people post their games and move on, but even just logging in to the site semi-regularly will result in more points for the user. Rating and commenting (especially commenting) the content of others' gives the most points.