05 January 2002Google working on paid-crawl service
Google appears to be developing a service aimed at extracting revenue from online firms that want a fresher search of their Web sites, following in the footsteps of rivals
AltaVista and
Inktomi.
A spokesperson for the company confirmed that
Google engineers are working on improving the freshness of the
search engine index. He refused to add any details of potential uses of the technology, but said that only certain sites, CNN.com for example, are being crawled every day, rather than the standard 30 days it takes Google to index the rest of the Web.
A service similar to Inktomi's Index Connect seems likely. Google's rival charges companies an annual fee to have their sites deep-crawled and indexed on a daily or weekly basis, for inclusion in the index (though it does not improve the pages' rankings).
Source
www.computerwire.com