Standards to hide webpages from Search Engines


	Standards to hide webpages from Search Engines

adamfalls

6-3-2008 8:53 PM

312 views

1 Comment |

Add a Comment

6-3-2008 10:56 PM

aklimento

If you publishing something, how you can want hide it from whole world? Unless it is some kind of murky game.

Login to Comment. Not a member yet? Sign up

Today's Top Clips

visit the Top Clips page

View the Top Clips from June 3, 2008

Embed This Clip In Your Site...

<div style="margin: 12px 0px; font-family: arial; color: #333333; background: #ffffff; border: solid 4px #e5e5e5; width: 100%; clear: left;"><div class="CM_CTB_Content_Wrap" style="margin: 0px; padding: 0px;background-color: #ffffff;"><div style="border-bottom: solid 1px #dcdcdc; white-space: nowrap; margin-bottom: 8px; background-color: #eeeeee ;background-image: url(http://clipmarks.com/images/source-bg.gif); background-repeat: repeat-x; height: 24px; line-height: 24px; vertical-align: middle; padding-bottom: 4px; color: #666666; font-size: 10px;" ><a href="http://clipmarks.com/clip-to-blog/" title="see clips that are hot right now"><img src="http://content.clipmarks.com/blog_embed/0f2c34df-ccb4-4f71-aa31-68d055e6d6b3/BBA0FADE-ABA9-4781-942C-007EB4374CCF/" alt="" width="19" height="19" border="0" style="vertical-align: middle; margin: 0px 4px; display: inline; border: none; float:none;" /></a>clipped from <a title="http://googleblog.blogspot.com/2008/06/more-on-robots-exclusion-protocol-rep.html" href="http://googleblog.blogspot.com/2008/06/more-on-robots-exclusion-protocol-rep.html" style="font-size: 11px;">googleblog.blogspot.com</a></div><blockquote style="text-align: left; padding: 0px 8px; margin: 4px 0px 8px 0px; background: transparent; border: none;" cite="http://googleblog.blogspot.com/2008/06/more-on-robots-exclusion-protocol-rep.html"><div align="center"><img src="http://content8.clipmarks.com/blog_cache/googleblog.blogspot.com/img/EE9A7175-D9C0-42DE-AD8B-221754386208" alt="The Official Google Blog - Insights from Googlers into our products, technology and the Google culture" /></div></blockquote><div style="height: 2px; font-size: 2px; background: #dcdcdc; border-bottom: solid 1px #f5f5f5; margin: 2px 4px;"></div><blockquote style="text-align: left; padding: 0px 8px; margin: 4px 0px 8px 0px; background: transparent; border: none;" cite="http://googleblog.blogspot.com/2008/06/more-on-robots-exclusion-protocol-rep.html"><H2 class="post-title"><A href="http://googleblog.blogspot.com/2008/06/more-on-robots-exclusion-protocol-rep.html">More on Robots Exclusion Protocol (REP)</A>
</H2>
<DIV class="post-body">
<DIV class="date-header">
6/03/2008 09:48:00 AM</DIV></DIV></blockquote><div style="height: 2px; font-size: 2px; background: #dcdcdc; border-bottom: solid 1px #f5f5f5; margin: 2px 4px;"></div><blockquote style="text-align: left; padding: 0px 8px; margin: 4px 0px 8px 0px; background: transparent; border: none;" cite="http://googleblog.blogspot.com/2008/06/more-on-robots-exclusion-protocol-rep.html"><DIV>Web publishers often ask us how they can maximize their visibility on the web. Much of this has to do with search engine optimization -- making sure a publisher's content shows up on all the search engines.</DIV></blockquote><div style="height: 2px; font-size: 2px; background: #dcdcdc; border-bottom: solid 1px #f5f5f5; margin: 2px 4px;"></div><blockquote style="text-align: left; padding: 0px 8px; margin: 4px 0px 8px 0px; background: transparent; border: none;" cite="http://googleblog.blogspot.com/2008/06/more-on-robots-exclusion-protocol-rep.html"><DIV>However, there are some cases in which publishers need to communicate more information to search engines -- like the fact that they <I id="by0r0">don't</I> want certain content to appear in search results. And for that they use something called the <A title="Robots Exclusion Protocol (REP)" id="x360" href="http://googleblog.blogspot.com/2007/01/controlling-how-search-engines-access.html">Robots Exclusion Protocol (REP)</A>, which lets publishers control how search engines access their site: whether it's controlling the visibility of their content across their site (via robots.txt) or down to a much more granular level for individual pages (via META tags).</DIV></blockquote><div style="height: 2px; font-size: 2px; background: #dcdcdc; border-bottom: solid 1px #f5f5f5; margin: 2px 4px;"></div><blockquote style="text-align: left; padding: 0px 8px; margin: 4px 0px 8px 0px; background: transparent; border: none;" cite="http://googleblog.blogspot.com/2008/06/more-on-robots-exclusion-protocol-rep.html">Over the last couple of years, we have worked with Microsoft and Yahoo! to bring forward standards such as <A target="_blank" href="http://www.sitemaps.org/" id="px.36">Sitemaps</A></blockquote><div style="height: 2px; font-size: 2px; background: #dcdcdc; border-bottom: solid 1px #f5f5f5; margin: 2px 4px;"></div><blockquote style="text-align: left; padding: 0px 8px; margin: 4px 0px 8px 0px; background: transparent; border: none;" cite="http://googleblog.blogspot.com/2008/06/more-on-robots-exclusion-protocol-rep.html">To see the major REP features currently implemented by Google, Microsoft, and Yahoo!</blockquote><div style="height: 2px; font-size: 2px; background: #dcdcdc; border-bottom: solid 1px #f5f5f5; margin: 2px 4px;"></div><blockquote style="text-align: left; padding: 0px 8px; margin: 4px 0px 8px 0px; background: transparent; border: none;" cite="http://googleblog.blogspot.com/2008/06/more-on-robots-exclusion-protocol-rep.html">see our <A href="http://googlewebmastercentral.blogspot.com/2008/06/improving-on-robots-exclusion-protocol.html">detailed post</A></blockquote></div><div style="margin: 0px 6px 6px 4px;"><table style="font-size: 11px;border-spacing: 0px;padding: 0px;" cellpadding="0" cellspacing="0" width="100%"><tr><td style="background:transparent;border-width:0px;padding:0px;">&nbsp;</td><td align="right" style="background:transparent;border-width:0px;padding:0px;width:107px" width="107"><a href="http://clipmarks.com/share/BBA0FADE-ABA9-4781-942C-007EB4374CCF/blog/" title="blog or email this clip"><img src="http://content9.clipmarks.com/images/c2b-foot.png" border="0" alt="blog it" width="107" height="17" style="border-width:0px;padding:0px;margin:0px;" /></a></td></tr></table></div></div>

New from the makers of Clipmarks: Amplify.com - Don't just share the news...Amplify it!

Clipmarks: Home; New Clips; Top Clips; Dashboard

Popular Topics: News; Life; Science; Technology; Entertainment

Get Started: Sign Up; Install Clipping Tool; How Clipping Works; Clip-to-Blog™; ClipSearch

Tools and Resources: FAQ; ClipWeek; Top Clippers; Top Tags; Site Map

About Clipmarks: About Us; Contact; Copyright; Privacy; EULA

Search Options

Today's Top Clips