itch.io is community of indie game creators and players

Big Improvements to Library-To-CSV Scraper

BACK IN APRIL I shared a blog entry about a UserScript that I wrote to scrape Itch libraries into CSV lists. You can read the initial post here

The original project came to fruition when I wanted to import a huge collection I had on here into an SQL database so I could pull a game at random.

The original script was okay.  It did the trick - it grabbed game titles and URLs and threw them into a csv... but I realized that I wanted more - maybe I was in the mood for a Platformer or an Adventure game but I kept rolling Simulation games.  Maybe I only wanted to focus on games by a certain author.

Well, problem solved - the script will scrape pretty much everything but the platform.  There's definitely still some clean-up that could be done in the code but I'm not really done with it yet I don't think.  I'd like to get it to what I want before I go in and clean things up more.

The link to the script hasn't changed - it's still available here: https://gist.github.com/abraxas86/ad72ba46b6cdd86dc63058bba0c629c2

You will need to install Tampermonkey in your browser to get it to work.


*Note: You need to scroll all the way to the bottom of the page to scrape the list, as it needs to load all the games to really do what it's meant to do.  If you refresh the page at the bottom before you scrape, you'll need to scroll all the way up, then jump back down to the bottom to get the button.

Read comments (8)