Skip to main content

Indie game storeFree gamesFun gamesHorror games
Game developmentAssetsComics
SalesBundles
Jobs
TagsGame Engines

Post mortem (and post review feedback)

A topic by Gaming Tardigrade created 35 days ago Views: 374 Replies: 16
Viewing posts 1 to 7
Submitted(+3)

Calling this post mortem is kind of ironic.

Hey there, I kinda just wanted to break down my thoughts after the jam in case anyone was interested. I do a fair bit of talking aloud and writing so was wondering if anyone had similar experiences.  

The game I made was a wacky physics based game where you shoot yourself out of a cannon in order to get injured to prove the dangers of competing products (I can see how people were confused about the theme there).

I'm incredibly grateful for everyone who played and rated my game, so many of you left such kind comments, it was really inspiring.

Given the large amount of positive comments, I'm seriously considering taking this game further, maybe even to a full release at some point.

Originally, I hoped my game had a chance of getting in the top 20 or so in entertainment, but I managed to fall short at roughly #163. I hoped there would be a chance Sean played it but oh well. Still top 13% ish is awesome so thank you everyone.

My game overall had a wide distribution of ratings with:

15.7% 5 star

29.2% 4 star

29.7% 3 star

10.8% 2 star

14.6% 1 star

If anyone has any insights into why the low ratings may be (I understand in most categories apart from fun factor a 1 or 2 star review). I was wondering if it was to do with a bug or something in the web build that prevented people from playing it so they just defaulted to a 1 or 2 star review as they couldn't play it as these 1 star reviews massively dragged down my overall.

If anyone wants me to do the same for their game, please leave a comment and I'll let you know my insights.

My game: https://itch.io/jam/jamsepticeye/rate/3931554#comments

Submitted (1 edit) (+5)

Yep, a lot of people seem confused by the overwhelming positivity, but I've explained it in other posts, a lot of people just fake being super positive and then give you 1-3 stars just so you can "return the favor" hoping you thought they were so positive they gave you 4-5. And also they don't want to be negative or critizice your game in fear of you being offended and retaliate with a low score.

As I said, my advice: join smaller jams, <200 participants,  people are way more awesome, less dishonest and less competitive and (mostly) genuinely vote and tell you how to improve your game. It's less competitive and more cooperative.

Also, some people were 1-staring games just to boost their own. So yeah, somehow, with all the amazing games, the amazing art of some games, the amazing ideas, the amazing mechanics that I've seen in this jam...  the winner is a simple unpolished unoriginal puzzle platformer with crappy pixel art graphics (and getting a 4.0 in visuals!!! WTH??) and no music. Some things just don't add up, but anyways, it is what it is man...

Submitted(+2)

Thanks for your response, yeah, I was a bit confused how that won but yeah, It's unfortunate that there was a lot of weird judging and deliberate low scores.

Submitted

Yep, my thoughts exactly.

I did a post about alternate voting systems that might be better for fairness.

Submitted(+5)

Based take. I didn't leave a comment on your game, but I honestly thought it was really good! Call me a conspiracist but I highly believe the top entries were rigged. I think your game has a lot of potential despite what misleading reviews say.

Submitted

Thank you so much!

I also wonder if some of the top games are also due to statistical bias as they (often) have few reviews which makes them less likely to have a 1 star review bomb. Some of the top ones actually do look really good but a lot seem to be placed higher on the list compared to some others that I played and  really enjoyed.

I appreciate your feedback.

Submitted (1 edit)

The statistical bias is actually accounted for by a backend algorithm. Essentially, any games with less reviews than the median are skewed proportionally lower to promote fairness. Of course, it's not a perfect solution but it is something the system considers.

Submitted(+1)

The voting system is very easy to rig if you have the time (and the morals) to do it. Most of the top games are well deserved (some of them amazing games, for instance "D.I.M." or "organ donor delivery") , but some things just don't add up...

Submitted(+3)

It happens! The current Itch voting system can definitely be a little messy,  technically, anyone could spam one-star ratings and throw things off, including big teams (which I'd never do, of course). For me, the whole point of a jam is to give honest feedback and help each other grow, not try to game the system.

But hey!! being in the top 200 out of over 1,000 games is something to be proud of! Our team landed around 163rd overall too, and we’re really happy with that. Honestly, that’s pretty great considering how many amazing entries there were.

It’s true that some of the highest-ranked games didn’t have a ton of reviews compared to others, which makes the results feel a little unbalanced  (also some def shouldn't have won imho) but that’s just how it goes sometimes. In the end, jams are objective by nature. What really matters is that people played, had fun, and connected with what we made.

We’re proud of what we built, proud of the feedback we received, and happy to have shared our work with everyone. Despite everything, from I could play (i couldnt write a review of it sadly ;-;) I really enjoyed your game! it def should've gotten higher imho

Submitted(+1)

Yeah, I completely agree with what you're saying, and I am incredibly pleased by my progress getting to the top 200, congratulations to your team too BTW, I looked at your score and it was really good.

Thank you for your kind words about my game! I am starting to realise more (as this is by far the biggest game jam I have ever participated in) that the final review is useful but the feedback you receive is vastly superior, helping you refine your skills.  

I haven't played your game yet but the visuals alone from the screenshots look stunning. And thank you for taking your time with replying to my post.

Submitted

Thank you for sharing your thoughts and questions.
I didn't try your game in the jam but wanted to try it now. 

For me the browser version was loading for like a minute or 2 and I can imagine some people were like 'screw this, it does not even load' or something like that. Or just 'that's taking too long'.

I wouldn't probably wait that long when I want to try as many games as possible essentially right after the jam. I'd suggest to optimize games more for the webGL - so it loads faster when you are planning web version.

Submitted

Yeah, thanks for trying it. I see how that's an issue. I didn't realise the problem as it loaded quickly on my PC. In the future, I'll try to improve the web GL optimisation.

Thanks!

Submitted

We all will try :D

Submitted (1 edit)

I didn't use the browser version as I saw written somewhere you had that it's best done via download. I think it was on the title screen? Yoo I gave you 5 stars for everything! Excited to hear your seriously considering taking it further!

I got 333rd myself, which was odd despite the positive kind words but what can you do? I agree my game wasn't pretty as I made everything myself during the 5 days in clip studio paint. So basically an ms paint game haha.

Not sure if I added this in my post on your game as I honestly criticized very little as it was in a short time span. But the game would greatly benefit from being able to control the character as they fly around. Not well of course, maybe like air control with resistance or control through small tugs or bursts to the rag doll.

Regardless I meant everything I said in my comments. I wish you the best of luck!!! If I haven't already followed I will now as I hope to see an update in the future.

Submitted

Thank you so much! Hearing your kind words is incredibly motivating. 

I agree a huge amount with the idea of air control, it was something I considered but never had enough time to technically implement. I think your suggestion would make the game a lot better.

I really appreciate you saying how much you enjoyed it, it means a lot.

Submitted

I'm unsure how genuine people are in general with their reviews, and I could see a lot of people intentionally giving poor reviews to bring others down to essentially get themselves on top. I'm not personally a fan of peer-reviewed contests like this for that reason, but I understand that it's practically impossible to experience every submission with a small number of judges.

I heard there were people who were going around and basically throwing people's submissions with bad ratings without even playing, or even people who were outright banned. It's not clear to me if those people had their ratings revoked. It might not have helped 100%, but also having a 5-10 minute timer before being able to rate after clicking download or play in browser could have mitigated this sort of behavior. 

Additionally it would have been nice if there were comments attached to reviews, somewhat like what you see on Steam. You could get more context on why someone may have given it a lower rating in certain categories.

In general it's a little surprising how heavily certain areas were critiqued considering it's a short jam. Perfect game balance or robust polished AI isn't something that someone can realistically develop that quickly for instance. It's not fairly judged against very simple mechanics like multiple choice slideshows, so doing something other than very simple seems very punishing, which is rather discouraging for participating in a game jam in the future.

Submitted(+1)

Good points you made.  It's unfortunate that there does seem to be a consensus that there were some clear either malicious poor reviews or just from people being a bit unbothered to actually try a game for more than a minute or so before leaving a poor review for inexplicable reasons.

I never played your jam submission but even still congrats on your placement (whilst overcoming some 'strange' judging in the gam)