Avoiding bot detection: How to scrape the web without getting blocked?

586 points by proszkinasenne2

Read the article

Discussion on Hacker News