A search engine - such as Yahoo! - will send out automated programs called 'spiders' to 'crawl' websites and to then report back information to Yahoo! about each site's keyphrases, inbound links (backlinks) and the amount of pages that the site contains. With this information Yahoo! will work out how it will rank a website in its search results pages.
Yahoo's update can be seen as significant, with reports of some sites being crawled by Yahoo!'s spiders over 10,000 times in one day.
This update sees Yahoo! perform a lot more web crawls and find a lot more links, therefore Yahoo! is now indexing a lot more pages. It doesn't, however, seem that the update has managed to get rid of much spam.
Many questions are still being asked of Yahoo! - and these results show us that Yahoo! hasn't given up the chase for the lead in internet search - but with when it comes to online search, can this internet giant keep up with the current search engine giant, Google?
