Ask YC: Where to start with creating a distributed crawler30 points by groovyoneDiscussion on Hacker News