Building a Wikipedia offline reader

Search Options	close
Search the following clips: All Clips

news science politics food economy art
technology health internet religion psychology

Sign Up Install Learn More Login


	Building a Wikipedia offline reader

kammo

8-22-2007 2:42 PM

355 views

tags:

wikipedia, dump, offline

kammo says:

nice and quite easy ... sometimes when you're outside with your laptop and you can't find an hot spot ... what you can do for your wiki-curiosity ?
Here's the answer

Add a Comment

Login to Comment. Not a member yet? Sign up

Today's Top Clips

visit the Top Clips page

View the Top Clips from August 22, 2007

Embed This Clip In Your Site...

<div style="margin: 12px 0px; font-family: arial; color: #333333; background: #ffffff; border: solid 4px #e5e5e5; width: 100%; clear: left;"><div class="CM_CTB_Content_Wrap" style="margin: 0px; padding: 0px;background-color: #ffffff;"><div style="border-bottom: solid 1px #dcdcdc; white-space: nowrap; margin-bottom: 8px; background-color: #eeeeee ;background-image: url(http://clipmarks.com/images/source-bg.gif); background-repeat: repeat-x; height: 24px; line-height: 24px; vertical-align: middle; padding-bottom: 4px; color: #666666; font-size: 10px;" ><a href="http://clipmarks.com/clip-to-blog/" title="see clips that are hot right now"><img src="http://content.clipmarks.com/blog_embed/6301b5dc-c985-4263-9438-2dfc9854d000/D60B4A67-6703-46CC-8F31-411778AAD4D4/" alt="" width="19" height="19" border="0" style="vertical-align: middle; margin: 0px 4px; display: inline; border: none; float:none;" /></a>clipped from <a title="http://www.softlab.ntua.gr/~ttsiod/buildWikipediaOffline.html" href="http://www.softlab.ntua.gr/~ttsiod/buildWikipediaOffline.html" style="font-size: 11px;">www.softlab.ntua.gr</a></div><blockquote style="text-align: left; padding: 0px 8px; margin: 4px 0px 8px 0px; background: transparent; border: none;" cite="http://www.softlab.ntua.gr/~ttsiod/buildWikipediaOffline.html"><H1>Building a (fast) Wikipedia offline reader</H1></blockquote><div style="height: 2px; font-size: 2px; background: #dcdcdc; border-bottom: solid 1px #f5f5f5; margin: 2px 4px;"></div><blockquote style="text-align: left; padding: 0px 8px; margin: 4px 0px 8px 0px; background: transparent; border: none;" cite="http://www.softlab.ntua.gr/~ttsiod/buildWikipediaOffline.html"><H2>Executive summary</H2></blockquote><div style="height: 2px; font-size: 2px; background: #dcdcdc; border-bottom: solid 1px #f5f5f5; margin: 2px 4px;"></div><blockquote style="text-align: left; padding: 0px 8px; margin: 4px 0px 8px 0px; background: transparent; border: none;" cite="http://www.softlab.ntua.gr/~ttsiod/buildWikipediaOffline.html"><li style="margin-left:16px;padding-left: 0px;">Very fast searching
</LI></blockquote><div style="height: 2px; font-size: 2px; background: #dcdcdc; border-bottom: solid 1px #f5f5f5; margin: 2px 4px;"></div><blockquote style="text-align: left; padding: 0px 8px; margin: 4px 0px 8px 0px; background: transparent; border: none;" cite="http://www.softlab.ntua.gr/~ttsiod/buildWikipediaOffline.html"><li style="margin-left:16px;padding-left: 0px;">Keyword (actually, title words) based searching
</LI></blockquote><div style="height: 2px; font-size: 2px; background: #dcdcdc; border-bottom: solid 1px #f5f5f5; margin: 2px 4px;"></div><blockquote style="text-align: left; padding: 0px 8px; margin: 4px 0px 8px 0px; background: transparent; border: none;" cite="http://www.softlab.ntua.gr/~ttsiod/buildWikipediaOffline.html"><li style="margin-left:16px;padding-left: 0px;">Search produces multiple possible articles: you can choose amongst them
</LI></blockquote><div style="height: 2px; font-size: 2px; background: #dcdcdc; border-bottom: solid 1px #f5f5f5; margin: 2px 4px;"></div><blockquote style="text-align: left; padding: 0px 8px; margin: 4px 0px 8px 0px; background: transparent; border: none;" cite="http://www.softlab.ntua.gr/~ttsiod/buildWikipediaOffline.html"><li style="margin-left:16px;padding-left: 0px;">LaTEX based rendering for Mathematics (thanks to the guys at woc.fslab.de)
</LI></blockquote><div style="height: 2px; font-size: 2px; background: #dcdcdc; border-bottom: solid 1px #f5f5f5; margin: 2px 4px;"></div><blockquote style="text-align: left; padding: 0px 8px; margin: 4px 0px 8px 0px; background: transparent; border: none;" cite="http://www.softlab.ntua.gr/~ttsiod/buildWikipediaOffline.html"><li style="margin-left:16px;padding-left: 0px;">Harddisk space is minimal: the original .bz2 file (split in pieces) plus the index built through Xapian
</LI></blockquote><div style="height: 2px; font-size: 2px; background: #dcdcdc; border-bottom: solid 1px #f5f5f5; margin: 2px 4px;"></div><blockquote style="text-align: left; padding: 0px 8px; margin: 4px 0px 8px 0px; background: transparent; border: none;" cite="http://www.softlab.ntua.gr/~ttsiod/buildWikipediaOffline.html"><li style="margin-left:16px;padding-left: 0px;">Orders of magnitude faster to install (a matter of hours) compared to loading the "dump" into MySQL
</LI></blockquote><div style="height: 2px; font-size: 2px; background: #dcdcdc; border-bottom: solid 1px #f5f5f5; margin: 2px 4px;"></div><blockquote style="text-align: left; padding: 0px 8px; margin: 4px 0px 8px 0px; background: transparent; border: none;" cite="http://www.softlab.ntua.gr/~ttsiod/buildWikipediaOffline.html"><P>
  Wouldn't it be perfect, if we could use the wikipedia "dump" data JUST as they arive after the download?
  Without creating a much larger (space-wize) MySQL database? And also be able to search for parts of title 
  names and get back lists of titles with "similarity percentages"?
  </P></blockquote><div style="height: 2px; font-size: 2px; background: #dcdcdc; border-bottom: solid 1px #f5f5f5; margin: 2px 4px;"></div><blockquote style="text-align: left; padding: 0px 8px; margin: 4px 0px 8px 0px; background: transparent; border: none;" cite="http://www.softlab.ntua.gr/~ttsiod/buildWikipediaOffline.html">Isn't the world of Open Source amazing? I was able to build this in two days, most of which were spent
searching for the appropriate tools. Simply unbelievable... toying around with these tools and writing less than 200
lines of code, and... presto!</blockquote></div><div style="margin: 0px 6px 6px 4px;"><table style="font-size: 11px;border-spacing: 0px;padding: 0px;" cellpadding="0" cellspacing="0" width="100%"><tr><td style="background:transparent;border-width:0px;padding:0px;">&nbsp;</td><td align="right" style="background:transparent;border-width:0px;padding:0px;width:107px" width="107"><a href="http://clipmarks.com/share/D60B4A67-6703-46CC-8F31-411778AAD4D4/blog/" title="blog or email this clip"><img src="http://content9.clipmarks.com/images/c2b-foot.png" border="0" alt="blog it" width="107" height="17" style="border-width:0px;padding:0px;margin:0px;" /></a></td></tr></table></div></div>

New from the makers of Clipmarks: Amplify.com - Don't just share the news...Amplify it!

Clipmarks: Home; New Clips; Top Clips; Dashboard

Popular Topics: News; Life; Science; Technology; Entertainment

Get Started: Sign Up; Install Clipping Tool; How Clipping Works; Clip-to-Blog™; ClipSearch

Tools and Resources: FAQ; ClipWeek; Top Clippers; Top Tags; Site Map

About Clipmarks: About Us; Contact; Copyright; Privacy; EULA

Search Options

Today's Top Clips