Ask YC: Any ideas about intelligent crawlers :)
19 points by franklymydear
Discussion on Hacker News