Comments and help on web development.
18  12 2007

Google Suggest Banning

I was just banned from Google Suggest for scraping their keyphrases.

I guess 100 simultaneous requests over a minute raises the red flag. I’m not 100% sure if it was the amount of requests, the duplicate keyphrases, or both combined, that lead to the ban.

However, I made the experience in the past, that only one request at the same time will not raise a red flag. Even if you do it over half an hour.

I hope they will unban my IP, soon. In the meantime I will add proxy-support to my scraper :)

Leave a Reply

« Keep focused! Zend_Mail Obstacles »