Skip to main content

Indie game storeFree gamesFun gamesHorror games
Game developmentAssetsComics
SalesBundles
Jobs
TagsGame Engines

robots file for game pages and profile page

A topic by hacknorris created Oct 11, 2023 Views: 1,149 Replies: 5
Viewing posts 1 to 3
(+1)

recently i saw russian yandex crawling my profile or games (5 times in this month!!! its even in stats…) 

maybe would you like to give me ability to filter them out?

either robots file or some gui management of page accessibility to other servers…

i know that itch mission is to publish games, yes? but i'd like to also be able to moderate that publishing by myself too…

yandex is just Russian Google, I wouldn't worry about it.

What specifically are you trying to avoid by stopping it from crawling your page?

cravling by evil. Just that

im trying to not be scraped by evil. Just that

im trying to avoid being seen by evil

Admin (1 edit)

Bot and crawler activity is generally not recorded in the analytics presented to you. If you are seeing Yandex in the referrers then it means that someone using their search engine has found your project linked and clicked the link.