ShadowCrawler is not “just another scraper.” It’s a full crawling framework designed for stability, modularity, and real‑world complexity:
- Domain autodetection
- Modular spiders
- Browser automation (Playwright)
- HTML‑only & full‑context modes
- Media extraction pipeline
- Auth handler support
- Clean architecture built for extension
If you work with web crawling, automation, or data extraction, ShadowCrawler gives you a solid foundation to build serious spiders without fighting the usual chaos.
👉 Download on itch.io:
https://shadowcrawlerframework.itch.io/shadowcrawler
👉 GitHub Release (v4.1.1) available now:
https://github.com/ShadowCrawlerFramework/ShadowCrawler/releases
If you try it, let me know what you build — I’m actively improving the framework and adding new spiders.