Crawling the web at $2 per million pages107 points by yarapavanRead the articleDiscussion on Hacker News