Building a Wikipedia offline reader


	Building a Wikipedia offline reader

kammo

8-22-2007 2:42 PM

256 views

tags:

wikipedia, dump, offline

kammo says:

nice and quite easy ... sometimes when you're outside with your laptop and you can't find an hot spot ... what you can do for your wiki-curiosity ?
Here's the answer

Add a Comment

Login to Comment. Not a member yet? Sign up

Google generation has no need for rote lea...

Neo-Gothic Châteaux Near Yalta

If the Party Isn't Identified - Does It Ex...

Cambodia: Khmer Rouge Victims

Column Of Thirty Marines Ambushed By 250 I...

25 Motivational Posters.

More clips from kammo

getStringFromObj()

When galaxy collides

Robot Internet Mashup

Today's Top Clips

visit the Top Clips page

View the Top Clips from August 22, 2007

Embed This Clip In Your Site...

<div style="margin: 12px 0px; font-family: arial; color: #333333; background: #ffffff; border: solid 4px #e5e5e5; width: 100%; clear: left;"><div class="CM_CTB_Content_Wrap" style="margin: 0px; padding: 0px;background-color: #ffffff;"><div style="border-bottom: solid 1px #dcdcdc; white-space: nowrap; margin-bottom: 8px; background-color: #eeeeee ;background-image: url(http://clipmarks.com/images/source-bg.gif); background-repeat: repeat-x; height: 24px; line-height: 24px; vertical-align: middle; padding-bottom: 4px; color: #666666; font-size: 10px;" ><a href="http://clipmarks.com/clip-to-blog/" title="see clips that are hot right now"><img src="http://content.clipmarks.com/blog_embed/5957e4e6-66ae-4ae7-ad55-bf3becc3b774/D60B4A67-6703-46CC-8F31-411778AAD4D4/" alt="" width="19" height="19" border="0" style="vertical-align: middle; margin: 0px 4px; display: inline; border: none; float:none;" /></a>clipped from <a title="http://www.softlab.ntua.gr/~ttsiod/buildWikipediaOffline.html" href="http://www.softlab.ntua.gr/~ttsiod/buildWikipediaOffline.html" style="font-size: 11px;">www.softlab.ntua.gr</a></div><blockquote style="text-align: left; padding: 0px 8px; margin: 4px 0px 8px 0px; background: transparent; border: none;" cite="http://www.softlab.ntua.gr/~ttsiod/buildWikipediaOffline.html"><H1>Building a (fast) Wikipedia offline reader</H1></blockquote><div style="height: 2px; font-size: 2px; background: #dcdcdc; border-bottom: solid 1px #f5f5f5; margin: 2px 4px;"></div><blockquote style="text-align: left; padding: 0px 8px; margin: 4px 0px 8px 0px; background: transparent; border: none;" cite="http://www.softlab.ntua.gr/~ttsiod/buildWikipediaOffline.html"><H2>Executive summary</H2></blockquote><div style="height: 2px; font-size: 2px; background: #dcdcdc; border-bottom: solid 1px #f5f5f5; margin: 2px 4px;"></div><blockquote style="text-align: left; padding: 0px 8px; margin: 4px 0px 8px 0px; background: transparent; border: none;" cite="http://www.softlab.ntua.gr/~ttsiod/buildWikipediaOffline.html"><li style="margin-left:16px;padding-left: 0px;">Very fast searching
</LI></blockquote><div style="height: 2px; font-size: 2px; background: #dcdcdc; border-bottom: solid 1px #f5f5f5; margin: 2px 4px;"></div><blockquote style="text-align: left; padding: 0px 8px; margin: 4px 0px 8px 0px; background: transparent; border: none;" cite="http://www.softlab.ntua.gr/~ttsiod/buildWikipediaOffline.html"><li style="margin-left:16px;padding-left: 0px;">Keyword (actually, title words) based searching
</LI></blockquote><div style="height: 2px; font-size: 2px; background: #dcdcdc; border-bottom: solid 1px #f5f5f5; margin: 2px 4px;"></div><blockquote style="text-align: left; padding: 0px 8px; margin: 4px 0px 8px 0px; background: transparent; border: none;" cite="http://www.softlab.ntua.gr/~ttsiod/buildWikipediaOffline.html"><li style="margin-left:16px;padding-left: 0px;">Search produces multiple possible articles: you can choose amongst them
</LI></blockquote><div style="height: 2px; font-size: 2px; background: #dcdcdc; border-bottom: solid 1px #f5f5f5; margin: 2px 4px;"></div><blockquote style="text-align: left; padding: 0px 8px; margin: 4px 0px 8px 0px; background: transparent; border: none;" cite="http://www.softlab.ntua.gr/~ttsiod/buildWikipediaOffline.html"><li style="margin-left:16px;padding-left: 0px;">LaTEX based rendering for Mathematics (thanks to the guys at woc.fslab.de)
</LI></blockquote><div style="height: 2px; font-size: 2px; background: #dcdcdc; border-bottom: solid 1px #f5f5f5; margin: 2px 4px;"></div><blockquote style="text-align: left; padding: 0px 8px; margin: 4px 0px 8px 0px; background: transparent; border: none;" cite="http://www.softlab.ntua.gr/~ttsiod/buildWikipediaOffline.html"><li style="margin-left:16px;padding-left: 0px;">Harddisk space is minimal: the original .bz2 file (split in pieces) plus the index built through Xapian
</LI></blockquote><div style="height: 2px; font-size: 2px; background: #dcdcdc; border-bottom: solid 1px #f5f5f5; margin: 2px 4px;"></div><blockquote style="text-align: left; padding: 0px 8px; margin: 4px 0px 8px 0px; background: transparent; border: none;" cite="http://www.softlab.ntua.gr/~ttsiod/buildWikipediaOffline.html"><li style="margin-left:16px;padding-left: 0px;">Orders of magnitude faster to install (a matter of hours) compared to loading the "dump" into MySQL
</LI></blockquote><div style="height: 2px; font-size: 2px; background: #dcdcdc; border-bottom: solid 1px #f5f5f5; margin: 2px 4px;"></div><blockquote style="text-align: left; padding: 0px 8px; margin: 4px 0px 8px 0px; background: transparent; border: none;" cite="http://www.softlab.ntua.gr/~ttsiod/buildWikipediaOffline.html"><P>
  Wouldn't it be perfect, if we could use the wikipedia "dump" data JUST as they arive after the download?
  Without creating a much larger (space-wize) MySQL database? And also be able to search for parts of title 
  names and get back lists of titles with "similarity percentages"?
  </P></blockquote><div style="height: 2px; font-size: 2px; background: #dcdcdc; border-bottom: solid 1px #f5f5f5; margin: 2px 4px;"></div><blockquote style="text-align: left; padding: 0px 8px; margin: 4px 0px 8px 0px; background: transparent; border: none;" cite="http://www.softlab.ntua.gr/~ttsiod/buildWikipediaOffline.html">Isn't the world of Open Source amazing? I was able to build this in two days, most of which were spent
searching for the appropriate tools. Simply unbelievable... toying around with these tools and writing less than 200
lines of code, and... presto!</blockquote></div><div style="margin: 0px 6px 6px 4px;"><table style="font-size: 11px;border-spacing: 0px;padding: 0px;" cellpadding="0" cellspacing="0" width="100%"><tr><td style="background:transparent;border-width:0px;padding:0px;">&nbsp;</td><td align="right" style="background:transparent;border-width:0px;padding:0px;width:107px" width="107"><a href="http://clipmarks.com/share/D60B4A67-6703-46CC-8F31-411778AAD4D4/blog/" title="blog or email this clip"><img src="http://content7.clipmarks.com/images/c2b-foot.png" border="0" alt="blog it" width="107" height="17" style="border-width:0px;padding:0px;margin:0px;" /></a></td></tr></table></div></div>

Clipmarks: Home; New Clips; Top Clips; Dashboard

Popular Topics: News; Life; Science; Technology; Entertainment

Get Started: Sign Up; Install Clipping Tool; How Clipping Works; Clip-to-Blog™; ClipSearch

Tools and Resources: FAQ; ClipWeek; Top Clippers; Top Tags; Site Map

About Clipmarks: About Us; Contact; Blog; Copyright; Privacy; EULA

Search Options

Related Clips

More clips from kammo

Today's Top Clips