< Back to Blog

Yahoo! Uses Distributed Computing to Speed up Search Index Processing
Tue, 26 Feb 2008 10:18:56 by Kerry Dye

After wading through the official blogs http://www.ysearchblog.com/archives/000521.html on this subject, which mainly deal with the fact it is the world's largest Hadoop installations, I've got a few interesting facts from the SEO point of view.

  • The Webmap (which is the database that feeds their algorithm) now generates in a third less time than it did before
  • It keeps track of roughly 1 trillion links
  • It uses 10,000 Linux cores (which doesn't mean 10,000 computers or even 10,000 processors, as processors are multi-core, but I guess it makes a nice round number)

So hopefully that's some information that might actually be of use when talking to someone non-technical or if you have a need to discuss it with a client.



Kerry Dye
Campaign Delivery Manager


Subscribe

Archives

Related Blogs
Search Engine Optimisation - Why Blogging Works
Tue, 7 Oct 2008 13:27:39 by Emily Mace
Search Engine Marketing Trends Update
Mon, 6 Oct 2008 15:03:19 by Matt Hopkins
bX-b0uqh3 Blogger fix
Mon, 6 Oct 2008 11:04:45 by Joe Bursell
Converting your website visitors - Forms
Mon, 6 Oct 2008 09:41:04 by Emily Mace
Voted one of the Best SEO Companies
Thu, 2 Oct 2008 14:59:31 by Matt Hopkins
Search Engine Optimisation - Things to Avoid
Thu, 2 Oct 2008 09:11:23 by Emily Mace
Google Search Interface Changes
Wed, 1 Oct 2008 16:05:56 by Kerry Dye