Search Options
close
Search the following clips:
All Clips
Everyone's Clips
My Guides
Sign Up
Install
Learn More
Login
One Change In the Openness of Government Found Today
BartendingBear
follow
4
1-21-2009 1:53 AM
225 views
BartendingBear
says:
What should we let the search engines read - BushCo compared to Obama?
2 Comments
|
Add a Comment
1-22-2009
11:26 AM
polymath22
Disallow 911? But why?
1-22-2009
3:55 PM
BartendingBear
Paranoia comes to mind.
Login
to Comment. Not a member yet?
Sign up
Today's Top Clips
Incredible Aerial Photography
Mind Control With Sound and Light
Time gets better with age
Carrie Prejean - XXX Fraud
Science Tattoo Emporium
Animals' eating habits
Caress me if you can ... (38 pics)
6 Most Annoying Coworker Types
3 American hikers that strayed into Iran charged with espionage, punishable by death
The Ripple Effect
visit the
Top Clips page
View the Top Clips from
January 21, 2009
Embed This Clip In Your Site...
<div style="margin: 12px 0px; font-family: arial; color: #333333; background: #ffffff; border: solid 4px #e5e5e5; width: 100%; clear: left;"><div class="CM_CTB_Content_Wrap" style="margin: 0px; padding: 0px;background-color: #ffffff;"><div style="border-bottom: solid 1px #dcdcdc; white-space: nowrap; margin-bottom: 8px; background-color: #eeeeee ;background-image: url(http://clipmarks.com/images/source-bg.gif); background-repeat: repeat-x; height: 24px; line-height: 24px; vertical-align: middle; padding-bottom: 4px; color: #666666; font-size: 10px;" ><a href="http://clipmarks.com/clip-to-blog/" title="see clips that are hot right now"><img src="http://content.clipmarks.com/blog_embed/2cbd0005-7c1f-4e9c-8565-21a771d38e53/F48272A1-41F1-41F3-B2EC-F8D1F0D479F6/" alt="" width="19" height="19" border="0" style="vertical-align: middle; margin: 0px 4px; display: inline; border: none; float:none;" /></a>clipped from <a title="http://www.kottke.org/09/01/the-countrys-new-robotstxt-file" href="http://www.kottke.org/09/01/the-countrys-new-robotstxt-file" style="font-size: 11px;">www.kottke.org</a></div><blockquote style="text-align: left; padding: 0px 8px; margin: 4px 0px 8px 0px; background: transparent; border: none;" cite="http://www.kottke.org/09/01/the-countrys-new-robotstxt-file"><P>Here's a small and nerdy measure of the huge change in the executive branch of the US government today. <A href="http://pastebin.com/f18309565" linkindex="4" set="yes">Here's the robots.txt file from whitehouse.gov yesterday</A>:</P></blockquote><div style="height: 2px; font-size: 2px; background: #dcdcdc; border-bottom: solid 1px #f5f5f5; margin: 2px 4px;"></div><blockquote style="text-align: left; padding: 0px 8px; margin: 4px 0px 8px 0px; background: transparent; border: none;" cite="http://www.kottke.org/09/01/the-countrys-new-robotstxt-file"><P>User-agent: *<BR />Disallow: /cgi-bin<BR />Disallow: /search<BR />Disallow: /query.html<BR />Disallow: /omb/search<BR />Disallow: /omb/query.html<BR />Disallow: /expectmore/search<BR />Disallow: /expectmore/query.html<BR />Disallow: /results/search<BR />Disallow: /results/query.html<BR />Disallow: /earmarks/search<BR />Disallow: /earmarks/query.html<BR />Disallow: /help<BR />Disallow: /360pics/text<BR />Disallow: /911/911day/text<BR />Disallow: /911/heroes/text</P></blockquote><div style="height: 2px; font-size: 2px; background: #dcdcdc; border-bottom: solid 1px #f5f5f5; margin: 2px 4px;"></div><blockquote style="text-align: left; padding: 0px 8px; margin: 4px 0px 8px 0px; background: transparent; border: none;" cite="http://www.kottke.org/09/01/the-countrys-new-robotstxt-file"><P>And it goes on like that <EM>for almost 2400 lines!</EM> <A href="http://www.whitehouse.gov/robots.txt" linkindex="5">Here's the new Obamafied robots.txt file</A>:</P></blockquote><div style="height: 2px; font-size: 2px; background: #dcdcdc; border-bottom: solid 1px #f5f5f5; margin: 2px 4px;"></div><blockquote style="text-align: left; padding: 0px 8px; margin: 4px 0px 8px 0px; background: transparent; border: none;" cite="http://www.kottke.org/09/01/the-countrys-new-robotstxt-file"><P>User-agent: *<BR />Disallow: /includes/</P></blockquote><div style="height: 2px; font-size: 2px; background: #dcdcdc; border-bottom: solid 1px #f5f5f5; margin: 2px 4px;"></div><blockquote style="text-align: left; padding: 0px 8px; margin: 4px 0px 8px 0px; background: transparent; border: none;" cite="http://www.kottke.org/09/01/the-countrys-new-robotstxt-file"><P>That's it! BTW, the robots.txt file tells search engines what to include and not include in their indexes. (thx, ian)</P></blockquote></div><div style="margin: 0px 6px 6px 4px;"><table style="font-size: 11px;border-spacing: 0px;padding: 0px;" cellpadding="0" cellspacing="0" width="100%"><tr><td style="background:transparent;border-width:0px;padding:0px;"> </td><td align="right" style="background:transparent;border-width:0px;padding:0px;width:107px" width="107"><a href="http://clipmarks.com/share/F48272A1-41F1-41F3-B2EC-F8D1F0D479F6/blog/" title="blog or email this clip"><img src="http://content8.clipmarks.com/images/c2b-foot.png" border="0" alt="blog it" width="107" height="17" style="border-width:0px;padding:0px;margin:0px;" /></a></td></tr></table></div></div>
Clipmarks
Home
New Clips
Top Clips
Dashboard
Popular Topics
News
Life
Science
Technology
Entertainment
Get Started
Sign Up
Install Clipping Tool
How Clipping Works
Clip-to-Blog™
ClipSearch
Tools and Resources
FAQ
ClipWeek
Top Clippers
Top Tags
Site Map
About Clipmarks
About Us
Contact
Blog
Copyright
Privacy
EULA
OK