Search Options
close
Search the following clips:
All Clips
Everyone's Clips
My Guides
Sign Up
Install
Learn More
Login
Google processes over 20 petabytes of data per day
spherepet
follow
0
1-9-2008 9:08 PM
576 views
tags:
google
,
processing
,
petabytes
Add a Comment
Login
to Comment. Not a member yet?
Sign up
Today's Top Clips
Our Bodies, Our Culture
32 Astounding Architectural Designs of Gingerbread Houses
Men prefer smell of bacon to babies
Photographs of snakes like you've never seen before
Aerial photographs of England
The History Of The Chocolate Chip Cookie
Paralyzed man 'turns thoughts into sounds'
I Think She Hates Me...
Candied Bacon!
Colourful Snowflakes
visit the
Top Clips page
View the Top Clips from
January 9, 2008
Embed This Clip In Your Site...
<div style="margin: 12px 0px; font-family: arial; color: #333333; background: #ffffff; border: solid 4px #e5e5e5; width: 100%; clear: left;"><div class="CM_CTB_Content_Wrap" style="margin: 0px; padding: 0px;background-color: #ffffff;"><div style="border-bottom: solid 1px #dcdcdc; white-space: nowrap; margin-bottom: 8px; background-color: #eeeeee ;background-image: url(http://clipmarks.com/images/source-bg.gif); background-repeat: repeat-x; height: 24px; line-height: 24px; vertical-align: middle; padding-bottom: 4px; color: #666666; font-size: 10px;" ><a href="http://clipmarks.com/clip-to-blog/" title="see clips that are hot right now"><img src="http://content.clipmarks.com/blog_embed/d0854e51-8b42-4761-a517-1e2d3a653d6f/3B815E35-CA4F-4B96-ABED-6B698A131F5C/" alt="" width="19" height="19" border="0" style="vertical-align: middle; margin: 0px 4px; display: inline; border: none; float:none;" /></a>clipped from <a title="http://www.niallkennedy.com/blog/2008/01/google-mapreduce-stats.html" href="http://www.niallkennedy.com/blog/2008/01/google-mapreduce-stats.html" style="font-size: 11px;">www.niallkennedy.com</a></div><blockquote style="text-align: left; padding: 0px 8px; margin: 4px 0px 8px 0px; background: transparent; border: none;" cite="http://www.niallkennedy.com/blog/2008/01/google-mapreduce-stats.html"><H2 class="posttitle">Google processes over 20 petabytes of data per day</H2></blockquote><div style="height: 2px; font-size: 2px; background: #dcdcdc; border-bottom: solid 1px #f5f5f5; margin: 2px 4px;"></div><blockquote style="text-align: left; padding: 0px 8px; margin: 4px 0px 8px 0px; background: transparent; border: none;" cite="http://www.niallkennedy.com/blog/2008/01/google-mapreduce-stats.html"><P>Google currently processes over 20 petabytes of data per day through an average of 100,000 <A href="http://labs.google.com/papers/mapreduce.html">MapReduce</A> jobs spread across its massive computing clusters. The average MapReduce job ran across approximately 400 machines in September 2007, crunching approximately 11,000 machine years in a single month. These are just some of the facts about the search giant's computational processing infrastructure <A href="http://doi.acm.org/10.1145/1327452.1327492">revealed in an <ACRONYM title="Association for Computing Machinery">ACM</ACRONYM> paper by Google</A> Fellows <A href="http://research.google.com/people/jeff/">Jeffrey Dean</A> and <A href="http://research.google.com/people/sanjay/">Sanjay Ghemawat</A>.</P></blockquote><div style="height: 2px; font-size: 2px; background: #dcdcdc; border-bottom: solid 1px #f5f5f5; margin: 2px 4px;"></div><blockquote style="text-align: left; padding: 0px 8px; margin: 4px 0px 8px 0px; background: transparent; border: none;" cite="http://www.niallkennedy.com/blog/2008/01/google-mapreduce-stats.html"><P>Twenty petabytes (20,000 terabytes) per <STRONG>day</STRONG> is a tremendous amount of data processing and a key contributor to Google's continued market dominance. Competing search storage and processing systems at Microsoft (<A href="http://research.microsoft.com/research/sv/dryad/">Dyrad</A>) and Yahoo! (<A href="http://lucene.apache.org/hadoop/">Hadoop</A>) are still playing catch-up to Google's suite of <A href="http://labs.google.com/papers/gfs.html"><ACRONYM title="Google File System">GFS</ACRONYM></A>, MapReduce, and <A href="http://labs.google.com/papers/bigtable.html">BigTable</A>.</P></blockquote><div style="height: 2px; font-size: 2px; background: #dcdcdc; border-bottom: solid 1px #f5f5f5; margin: 2px 4px;"></div><blockquote style="text-align: left; padding: 0px 8px; margin: 4px 0px 8px 0px; background: transparent; border: none;" cite="http://www.niallkennedy.com/blog/2008/01/google-mapreduce-stats.html">Google processes</blockquote><div style="height: 2px; font-size: 2px; background: #dcdcdc; border-bottom: solid 1px #f5f5f5; margin: 2px 4px;"></div><blockquote style="text-align: left; padding: 0px 8px; margin: 4px 0px 8px 0px; background: transparent; border: none;" cite="http://www.niallkennedy.com/blog/2008/01/google-mapreduce-stats.html">two 2 <ABBR title="gigahertz">GHz</ABBR> Intel Xeon processors with Hyper-Threading enabled, 4 <ABBR title="gigabytes">GB</ABBR> of memory, two 160 <ABBR>GB</ABBR> <ACRONYM title="Integrated Drive Electronics">IDE</ACRONYM> hard drives and a gigabit Ethernet link.</blockquote></div><div style="margin: 0px 6px 6px 4px;"><table style="font-size: 11px;border-spacing: 0px;padding: 0px;" cellpadding="0" cellspacing="0" width="100%"><tr><td style="background:transparent;border-width:0px;padding:0px;"> </td><td align="right" style="background:transparent;border-width:0px;padding:0px;width:107px" width="107"><a href="http://clipmarks.com/share/3B815E35-CA4F-4B96-ABED-6B698A131F5C/blog/" title="blog or email this clip"><img src="http://content7.clipmarks.com/images/c2b-foot.png" border="0" alt="blog it" width="107" height="17" style="border-width:0px;padding:0px;margin:0px;" /></a></td></tr></table></div></div>
New from the makers of Clipmarks:
Amplify.com - Don't just share the news...Amplify it!
Clipmarks
Home
New Clips
Top Clips
Dashboard
Popular Topics
News
Life
Science
Technology
Entertainment
Get Started
Sign Up
Install Clipping Tool
How Clipping Works
Clip-to-Blog™
ClipSearch
Tools and Resources
FAQ
ClipWeek
Top Clippers
Top Tags
Site Map
About Clipmarks
About Us
Contact
Copyright
Privacy
EULA
OK