Search Options
close
Search the following clips:
All Clips
Everyone's Clips
My Guides
Sign Up
Install
Learn More
Login
Jeff Dean on Google Infrastructure
farrider
follow
0
6-17-2008 3:20 AM
91 views
Add a Comment
Login
to Comment. Not a member yet?
Sign up
Related Clips
God, how can the people responsible for th...
On Stupidity
Nationalisation Protects Finance Markets
Republican red faces as regulators close ...
200 orgasms a day
12 Weirdest Things Ever Insured
100 Extensive University Libraries from Ar...
More clips from
farrider
Craziest Houses
Theory Of Sun's Role In Formation Of Solar...
'Milky seas' detected from space
Today's Top Clips
List of books Palin wanted banned--wow!
Five Women Buried Alive - and the Media Ignore It
Why is pleasure so suspicious?
Who thinks this is a good reason to remove an account?
The Psychology of Conservatism
Violent Language, violent mind
The investigation of laughter is belatedly becoming a science..:-)
Amazingly Creative Art
The Teen Brain
Fear Is The Cheapest Room In The House
visit the
Top Clips page
View the Top Clips from
June 17, 2008
Embed This Clip In Your Site...
<div style="margin: 12px 0px; font-family: arial; color: #333333; background: #ffffff; border: solid 4px #e5e5e5; width: 100%; clear: left;"><div class="CM_CTB_Content_Wrap" style="margin: 0px; padding: 0px;background-color: #ffffff;"><div style="border-bottom: solid 1px #dcdcdc; white-space: nowrap; margin-bottom: 8px; background-color: #eeeeee ;background-image: url(http://clipmarks.com/images/source-bg.gif); background-repeat: repeat-x; height: 24px; line-height: 24px; vertical-align: middle; padding-bottom: 4px; color: #666666; font-size: 10px;" ><a href="http://clipmarks.com/clip-to-blog/" title="see clips that are hot right now"><img src="http://content.clipmarks.com/blog_embed/0847a6c2-45b5-484e-82c7-4edeafd775f4/835FCF19-F6D1-4E47-BFD1-0F70F0F590A4/" alt="" width="19" height="19" border="0" style="vertical-align: middle; margin: 0px 4px; display: inline; border: none; float:none;" /></a>clipped from <a title="http://perspectives.mvdirona.com/2008/06/11/JeffDeanOnGoogleInfrastructure.aspx" href="http://perspectives.mvdirona.com/2008/06/11/JeffDeanOnGoogleInfrastructure.aspx" style="font-size: 11px;">perspectives.mvdirona.com</a></div><blockquote style="text-align: left; padding: 0px 8px; margin: 4px 0px 8px 0px; background: transparent; border: none;" cite="http://perspectives.mvdirona.com/2008/06/11/JeffDeanOnGoogleInfrastructure.aspx"><P class="MsoNormal"><FONT color="#000000" face="Calibri" size="3">More detail on the typical failures during the first year of a cluster from Jeff:</FONT></p> <P class="MsoListParagraph"><FONT color="#000000"><SPAN><SPAN><FONT size="3">·</FONT><SPAN> </SPAN></SPAN></SPAN><FONT face="Calibri" size="3">~0.5 overheating (power down most machines in <5 mins, ~1-2 days to recover)</FONT></FONT></p> <P class="MsoListParagraph"><FONT color="#000000"><SPAN><SPAN><FONT size="3">·</FONT><SPAN> </SPAN></SPAN></SPAN><FONT face="Calibri" size="3">~1 PDU failure (~500-1000 machines suddenly disappear, ~6 hours to come back)</FONT></FONT></p> <P class="MsoListParagraph"><FONT color="#000000"><SPAN><SPAN><FONT size="3">·</FONT><SPAN> </SPAN></SPAN></SPAN><FONT face="Calibri" size="3">~1 rack-move (plenty of warning, ~500-1000 machines powered down, ~6 hours)</FONT></FONT></p> <P class="MsoListParagraph"><FONT color="#000000"><SPAN><SPAN><FONT size="3">·</FONT><SPAN> </SPAN></SPAN></SPAN><FONT face="Calibri" size="3">~1 network rewiring (rolling ~5% of machines down over 2-day span)</FONT></FONT></p> <P class="MsoListParagraph"><FONT color="#000000"><SPAN><SPAN><FONT size="3">·</FONT><SPAN> </SPAN></SPAN></SPAN><FONT face="Calibri" size="3">~20 rack failures (40-80 machines instantly disappear, 1-6 hours to get back)</FONT></FONT></p> <P class="MsoListParagraph"><FONT color="#000000"><SPAN><SPAN><FONT size="3">·</FONT><SPAN> </SPAN></SPAN></SPAN><FONT face="Calibri" size="3">~5 racks go wonky (40-80 machines see 50% packetloss)</FONT></FONT></p> <P class="MsoListParagraph"><FONT color="#000000"><SPAN><SPAN><FONT size="3">·</FONT><SPAN> </SPAN></SPAN></SPAN><FONT face="Calibri" size="3">~8 network maintenances (4 might cause ~30-minute random connectivity losses)</FONT></FONT></p> <P class="MsoListParagraph"><FONT color="#000000"><SPAN><SPAN><FONT size="3">·</FONT><SPAN> </SPAN></SPAN></SPAN><FONT face="Calibri" size="3">~12 router reloads (takes out DNS and external vips for a couple minutes)</FONT></FONT></p> <P class="MsoListParagraph"><FONT color="#000000"><SPAN><SPAN><FONT size="3">·</FONT><SPAN> </SPAN></SPAN></SPAN><FONT face="Calibri" size="3">~3 router failures (have to immediately pull traffic for an hour)</FONT></FONT></p> <P class="MsoListParagraph"><FONT color="#000000"><SPAN><SPAN><FONT size="3">·</FONT><SPAN> </SPAN></SPAN></SPAN><FONT face="Calibri" size="3">~dozens of minor 30-second blips for dns </FONT></FONT></p> <P class="MsoListParagraph"><FONT color="#000000"><SPAN><SPAN><FONT size="3">·</FONT><SPAN> </SPAN></SPAN></SPAN><FONT face="Calibri" size="3">~1000 individual machine failures</FONT></FONT></p> <P class="MsoListParagraph"><FONT color="#000000"><SPAN><SPAN><FONT size="3">·</FONT><SPAN> </SPAN></SPAN></SPAN><FONT face="Calibri" size="3">~thousands of hard drive failures</FONT></FONT></P></blockquote></div><div style="margin: 0px 6px 6px 4px;"><table style="font-size: 11px;border-spacing: 0px;padding: 0px;" cellpadding="0" cellspacing="0" width="100%"><tr><td style="background:transparent;border-width:0px;padding:0px;"> </td><td align="right" style="background:transparent;border-width:0px;padding:0px;width:107px" width="107"><a href="http://clipmarks.com/share/835FCF19-F6D1-4E47-BFD1-0F70F0F590A4/blog/" title="blog or email this clip"><img src="http://content6.clipmarks.com/images/c2b-foot.png" border="0" alt="blog it" width="107" height="17" style="border-width:0px;padding:0px;margin:0px;" /></a></td></tr></table></div></div>
Clipmarks
Home
New Clips
Top Clips
Dashboard
Popular Topics
News
Life
Science
Technology
Entertainment
Get Started
Sign Up
Install Clipping Tool
How Clipping Works
Clip-to-Blog™
ClipSearch
Tools and Resources
FAQ
ClipWeek
Top Clippers
Top Tags
Site Map
About Clipmarks
About Us
Contact
Blog
Copyright
Privacy
EULA
OK