Sunday, September 04, 2005

Yahoo! Slurp

Yahoo! Slurp is Yahoo!'s web-indexing robot. The Yahoo! Slurp crawler collects documents from the Web to build a searchable index for search services using the Yahoo! search engine. These documents are discovered and crawled because other web pages contain links directing to these documents.

Yahoo's bot has been slurping this blog.

No comments: