1. Show HN: Trawl β a self-hosted engine for scraping sites behind challenge walls (trawl.germondai.com)
Scrape protected websites with adaptive HTTP and browser tiers, CAPTCHA handling, session caching, and a challenge-aware proxy.