The robots.txt Adventure

26 points by charzom

Read the article

Discussion on Hacker News