Skip to main content

Indie game storeFree gamesFun gamesHorror games
Game developmentAssetsComics
SalesBundles
Jobs
TagsGame Engines

Itch Not Responding To Bot Activity and Review Bombing

A topic by Story Anon created Apr 03, 2023 Views: 2,005 Replies: 20
Viewing posts 1 to 10
(+3)

Back in January I had to ban another game developer from my Discord server due to him continually harrassing other users. Since then, I've been receiving botted reviews every update as some form of petty retribution. 

I know it's him because he's been banned from other sites for review manipulation already.

At the moment, I'm nearing two dozen 1-star reviews left by  30 second old accounts with gibberish bot names that go on to never download, follow or play any other games on itch. 

I have reported every single one and opened three tickets over the past 3 months. (Ticket IDs: 149788, 146751 and 142084 respectively)

The first ticket (opened in February) did receive a reply and removed about 5 of these reviews. However, since then I have received far more of them and the subsequent next two tickets (Filed March 7th and last week respectively)  never received any replies from itch.io support staff.

Now with my latest update, I'm receiving more botted 1-star reviews in a single 24 hour period then I normally receive in a week.

I realize that itch support is extremely understaffed for how much traffic it receives, but this situation is becoming untenable and the complete lack of communication is extremely frustrating. This is only exacerbated by the fact that reviews are not public and that only developers can report them, yet the requirements for leaving a review are absolutely minimal.

It goes without saying that major platforms like Steam have far higher requirements for leaving a review in order to prevent this exact sort of abuse, but it's fairly insulting when even piracy forums like F95 seem to take this problem far more seriously. 

I have no issue receiving negative feedback, but such clear abuse of a system meant to help curate content for players is actively caustic to the health of this site, and I really doubt my project is the only one suffering from this considering how trivial it is to bot here.

Pinned ReplyAdmin (2 edits) (+1)

Unfortunately we can’t respond to your rating reports in real time. It looks like when posted your request the ratings had been only created hours ago. Please continue to report the ratings if you suspect them which will allow us to process them when we get the opportunity. We tend to process account suspensions in bulk.

I understand you are frustrated, but I just want to clear up a couple misconceptions you are spreading in this thread since they can often do more damage than good.

Itch.io doesn’t even require a captcha to make a new account.

The details of our risk mitigation systems are much more complicated than you can tell at a cursory glance. Generally speaking “human scale” activities are not blocked by captcha. Captcha is generally only suitable for limiting automated activities. Given the relatively small number of negative reviews you have received, it’s likely just a person clicking through and doing it manually. A captcha will have no impact here, as the individual is motivated to leave the negative review, they will complete all the steps to still do it.

I’m quite sure this could be fixed with a minimal amount of work, but at this point I’d just be happy getting these malicious ratings taken down and some sort of answer from itch.io at all.

The nature of threat mitigation is very complicated. There is unfortunately no switch we can turn on that will solve this problem for you. Especially for a free game, if someone has a conflict with you and decides to create accounts to negatively review your game, our automated systems are not going to prevent that activity unless they are using automated systems themselves. You will need to report the pages so a human can review the activity. If you aren’t willing to accept the potential risks that a public rating system entails then I recommend disabling ratings and reviews on your page.

Hope that explains

(+1)

Hi Leafo,

Thank you for responding. 

You're right that most of this stems from frustration, but I think it's an avoidable frustration.

 However, I do want to thank you for taking the time to respond and with that, I consider my part in this issue concluded. All I wanted was confirmation that there was a human handling these issues and that's obviously the case now.

I do have a few comments in response, but these are aimed at being purely constructive. I'm satisfied with the conclusion as-is.

The details of our risk mitigation systems are much more complicated than you can tell at a cursory glance. Generally speaking “human scale” activities are not blocked by captcha. Captcha is generally only suitable for limiting automated activities.

The point about captcha isn't that captcha itself would be a viable solution for the problem we were facing, it's that there are essentially no measures taken at all during account creation or at the beginning of an account's life to verify its legitimacy.  This is not industry standard by any means.

However, you are correct in that this would not stop a malicious actor from doing these manually. That being said, it doesn't change the fact that it's still a glaring vulnerability that isn't present on the majority of your competitors. 

The nature of threat mitigation is very complicated. There is unfortunately no switch we can turn on that will solve this problem for you.

There are certainly smaller steps that can be made to further mitigate this, as seen on the review systems of large forums like F95 which have to deal with millions of free accounts too. Small requirements for leaving reviews, such as a certain amount of activity, downloads or even just making a purchase could make the barrier to entry for abuse high enough to dissuade bad actors, or at least limit the scope of it.

Moreover, having reviews be almost entirely hidden puts the impetous of action solely on the developer to self-police their own review boards. This does work to an extent with malicious reviews left on other pages, but what about bad actors who use the same idea to potentially boost their own pages? Nobody would ever catch that if they weren't doing anything to trigger the automated bot response.

That being said, even doing something like disabling review submissions from VPNs would be massive for both botting and manual abuse.

Especially for a free game, if someone has a conflict with you and decides to create accounts to negatively review your game, our automated systems are not going prevent activity unless they are using automated systems themselves.

Now of course, I may be putting far more importance on this because I frankly have no idea how much ratings even matter as far as itch.io analytics go (I understand that you're probably not liable to reveal anything about that and I won't ask you to).

However, even as a free game itch.io is an enormous amount of exposure and this is my full time job as seen by my non-trival Patreon, so it's just as vital as any other platform I host my game on. I don't think I'm unreasonable for being concerned about something that could potentially affect my livelihood and I don't want these concerns written off as some egotistical developer having a hissy fit over nothing.

If you aren’t willing to accept the potential risks that a public rating system entails then I recommend disabling ratings and reviews on your page.

Accepting risk is only one part, mitigating risk exposure is the other side of that same coin and as a platform that facilitates the livelihoods of the same creators who keep your site alive, you do bear some responsibility in helping to prevent abuse of the systems you own. That's coding ethics 101.

But again, I do consider this matter closed with your involvement whatever the outcome overall maybe. I hope you'll consider my feedback, and I thank you for your time.

(1 edit) (+4)

And for context, this is what my feed has looked like for the past several days. 

Deleted 1 year ago
(+1)

That's exactly the problem and exactly why it's so prone to abuse. 

When someone on itch.io leaves a review, anyone who's following them can see that review in full on their feed. It's clearly not intended to be private information since it's straight up published to anyone who decides to follow you. (Of course, almost nobody knows this because absolutely no documentation exists for anything regarding reviews)

Deleted 1 year ago
Deleted 1 year ago
(+1)

That is certainly one way of handling it, which is part of the reason this is so frustrating: Many, many sites have implemented working solutions to this problem to the point that it's an industry standard.

Itch.io doesn't even require a captcha to make a new account.

Nothing being asked for here is revolutionary, nor would it necessarily require huge amounts of effort on part of the itch.io development team. Expensive anti-bot software certainly exists, but it's almost assuredly unnecessary for this site. 

I'm quite sure this could be fixed with a minimal amount of work, but at this point I'd just be happy getting these malicious ratings taken down and some sort of answer from itch.io at all. 

Deleted 1 year ago
(1 edit) (+1)

Considering with my last update down there, almost every single review in that screenshot was just removed and the only one's left are literal patrons of mine, I think everybody legitimate is safe.

Deleted 1 year ago

You know what, if an admin, a moderator or anyone listed in those screenshots asks for me to change that image I will.

until then, I would really appreciate if you stop trying to derail this thread to sate your own imagined grievances. This thread is about an issue so much bigger than this.

Deleted 1 year ago
Admin

Please remove the image.

(+1)

Mate you guys have been having a circular argument for 8 messages, if you think it's a breach of the privacy policy just hit the report button and the mods will deal with it. And the other guy will also be happy because then they'll have to acknowledge they've seen this post.

(+1)

And for the record, getting an admin in here at all for any reason whatsoever would be an improvement.

(3 edits) (+3)

And already another one. 

(1 edit) (+3)

And hey look, another one already.

 I think the fact that I can live-blog these happening in real time should put in perspective how bad this has gotten.

(1 edit) (+2)

And another.

It's funny, all of these bots are following exactly 1 game and it sure isn't mine. 

What a coincidence.

(1 edit) (+2)

One more.

Totally organic traffic.

(1 edit) (+2)


One more to the list.

This isn't even everything from the last day, just what I've gotten since I created this thread. 

I would say my point has been thoroughly made, but the silence here is deafening.

(+2)

Another day, no response. 

If you're a volunteer or fellow developer and would like to help improve this site, please help me get itch's attention.

I've tweeted them here (https://twitter.com/story_anon/status/1643043666691497984?s=20) and haven't gotten any response there, but this is an issue that will affect all of us if this vulnerability is left unchanged.

(1 edit) (+1)

An important update:

It looks like most of the dummy accounts were deleted early this morning, and by pure coincidence Champion of Realms lost almost the EXACT amount of reviews.

I hesitated with naming who I suspected of committing this botting until I had definitive proof, but now we do.

My game reviews now:

*removed per admin request*

Champion of Realm's game reviews now:




Champion of Realm's game reviews yesterday afternoon sometime:



If this isn't clear and evident proof of review manipulation, I have no idea what else could be. 

Itch.io would obviously have logs of all of this, making the act of deleting them not only useless, but actively stupid.

All they need to do is actually respond.

This topic has been auto-archived and can no longer be posted in because there haven't been any posts in a while.