http://127.0.0.1:8090 Parent, Painter, Programmer Sun, 30 May 2004 10:23:16 +0000 en-US hourly 1 https://wordpress.org/?v=7.1 http://127.0.0.1:8090/miragorobot.htm http://127.0.0.1:8090/miragorobot.htm#respond Sun, 30 May 2004 10:23:16 +0000 http://www.hjackson.org/wp/?p=113 I have seen plenty of robots spider my site but by far the most polite as far as time goes has got to be the miragorobot. It waited a full minute between each page request which is almost unheard of.

]]> http://127.0.0.1:8090/miragorobot.htm/feed 0 http://127.0.0.1:8090/500000_pages.htm http://127.0.0.1:8090/500000_pages.htm#respond Wed, 26 May 2004 04:11:05 +0000 http://www.hjackson.org/wp/?p=111 The spiders have now collected over 500,000 pages. Considering I have been taking it easy it was surprisingly fast. I now need another 500,000 to get my goal of 1 Million for testing.

]]> http://127.0.0.1:8090/500000_pages.htm/feed 0