A spokesperson for the company confirmed that Google engineers are working on improving the freshness of the search engine index. He refused to add any details of potential uses of the technology, but said that only certain sites, CNN.com for example, are being crawled every day, rather than the standard 30 days it takes Google to index the rest of the Web.
A service similar to Inktomi's Index Connect seems likely. Google's rival charges companies an annual fee to have their sites deep-crawled and indexed on a daily or weekly basis, for inclusion in the index (though it does not improve the pages' rankings).
Source www.computerwire.com
