Yahoo Slurp

By Harry on April 18, 2007 10:32 AM | | Comments (0)
Add to delicious Digg This Add to My Yahoo! Add to Google Add to StumbleUpon

Not sure if anyone else has noticed recently but Slurp has been doing a lot of of Spidering lately. I actually took extreme measures today and added a crawl delay to the site.

Categories:

Leave a comment

About this Entry

This page contains a single entry by Harry published on April 18, 2007 10:32 AM.

WWW::Mechanize Fun was the previous entry in this blog.

Debian NO_PUBKEY is the next entry in this blog.

Find recent content on the main index or look in the archives to find all content.

Powered by Movable Type 4.01

Search