1src Forums - Wikipedia for TX?

MikeB

08-05-2008, 09:14 AM

I'd love to have a portable version of wikipedia for my TX. As far as I could find out, there is a paid version for tomeraider but it hasn't been updated in a while. There was some work to try and make a version for Plucker, but it looks like it will be 2030 before that's finished. ;)

Anyway, I came across wikitaxi yesterday at:
http://www.yunqa.de/delphi/doku.php/products/wikitaxi/index

Does anyone know how hard it would be to do something similar for the Palm platform, using Plucker or something similar?

Gregte

08-05-2008, 09:44 AM

I'd love to have a portable version of wikipedia for my TX. As far as I could find out, there is a paid version for tomeraider but it hasn't been updated in a while...

There is the 900,000 entry version for the Palm and then there is the newer 1,800,000 entry version for the Palm also. It is quite new. But having said that, I am still using the older 900,000 entry version (2005 edition) because it is much smaller and it consists of a single document, and it has images. The newer version supposedly does not have the images in the main file and it is also divided into two files. this sounds like more cumbersomeness to me.

But even the 900,000 entry version is still purported to be larger than any other encyclopedia. It is a free download (or at least I know it used to be) or you can buy it on DVD. I chose the latter as there is no way I can download a 2 GB file on my 28.8 kbps dial-up connection.

I use it daily on my TX and would not really want the TX without it. It is very rare for me to look for an article and find it does not exist.

Anyway, the only reason you have to pay for the DVD is to pay for the guys expenses. It is public domain of course. If you cannot find the 900,000 article version and you do want it, just PM me and I will burn you a copy and mail it to you, if you will pay postage and cost of a DVD+R.

TomeRaider does cost money though. I recommend V3.1.0.8, NOT 3.1.1 as the latter has issues that cause it to not find a large number of articles in Wikipedia.

raspabalsa

08-05-2008, 12:03 PM

I use the 971000 entry version with no images, created in december 2005. It's a single 1.1GB file that fits nicely in my 2GB SD card. As Gregte said, it's a very complete encyclopedia. I downloaded it free from here (http://download.wikimedia.org/tomeraider/). There are several language versions available.

As for TomeRaider, it's a somewhat costly program, but it's very much worth it IMO, even if I only use it to browse the wikipedias. The problem with latest versions of TR is that they get messed up with accented letters, so version 3.1.0.8 is what you need to use.

MikeB

08-05-2008, 01:33 PM

Thanks. However, I was hoping to find a plucker version since at over $30, TR is quite expensive.

raspabalsa

08-05-2008, 02:00 PM

I haven't seen any wikipedia released in Plucker. Headcronie, a fellow member, did try to convert the wikipedia to iSilo format, but iSilo's own limits forced him to desist (check details here (http://www.1src.com/forums/showthread.php?t=123725). I guess Plucker could meet similar problems.

Maybe you could try the TR trial version. Download one of the smaller wikipedia files, then give it ago. Who knows, you may end up finding it a worthy purchase.

Another Michael

08-05-2008, 03:57 PM

Wiki for mobipocket

http://pinguinburg.de/wpmp

vovka1965

08-05-2008, 06:20 PM

While MobiPocket reader is free, it is also more than twice the size of Tome Raider reader -- how come?

vovka1965

08-05-2008, 09:28 PM

... then there is the newer 1,800,000 entry version for the Palm also. It is quite new. B
I cannot find this new version or a link to it.. The TomeRaider website keeps saying that Palm-compatible new version is in the works...

Gregte

08-06-2008, 06:56 AM

The website I have found:
http://infodisiac.com/Wikipedia/Order.html
says that it is available however it says it is available to order, not for download. And to top it off it says "Shop closed until August 2008". It is now of course August but nothing has changed at this website.

Azure_Acolyte

08-06-2008, 07:42 AM

An alternative solution, if you have a data connection of some kind is either Wapedia (wapedia.mobi) or maxpedia.org. Both are mobile versions of wikipedia pages.

lichan

08-16-2008, 12:30 PM

Wiki for mobipocket

http://pinguinburg.de/wpmp

Has anyone successfully downloaded and unzipped the English version from the above site? I've tried several times with different browsers and 7Z always returns an error when I try to unzip the downloaded file (as does gzip on Unix). The operator responded via email that it works for him and suspects the ftp client cannot handle these type of files. I've never had a problem with I.E. or Firefox downloading tar and tgz files before. Can someone else try and see if they succeed? Thanks.

MikeB

08-16-2008, 02:20 PM

I had the same issues, but second time I used 7z to uncompress and it worked.

_Em

08-16-2008, 03:41 PM

GJtokkel

08-19-2008, 02:06 AM

7Z is 7-zip -- you can get the Windows decompression software from 7-zip.org -- I wrote a Mac compression/decompression tool for it a few years back that's floating around, and the Linux version is in the software repos.

IZARC is free and does decompress it.

I have the dutch version installed and works fine. The only thing is that besides a lot of '.prc's' the the archive also contains a large file without any file-extention. I did not install that file but I also do not know if that's needed (are those images???)

juggernaut#2

01-15-2009, 04:33 AM

where can I find an english mobipocket wiki version that doesn´t have 4 gigs? on wpmp, they only host the whole thing, which is quite a lot. I´d like to have a fairly recent version about 1 gig in size, images not required.

anybody got a link?

authorandrew

01-15-2009, 07:13 AM

I tried the 1.1 gb version that has been mentioned in here before and liked it. never used it, so I took it off. I also tried the 40 mb one which you can download from tr's site. Unfortunately, it is not very complete, only 100,000 articles.

To find the 1.1 gb file, go to tr's site and select the newest wikipedia file (the complete one) There should be a link on there for the old version. Download still works

lichan

01-15-2009, 12:33 PM

Does anyone have a link for the 2005 Wikipedia 900,000 entry with images version?

cyberdude

01-15-2009, 01:39 PM

Has anyone successfully downloaded and unzipped the English version from the above site? I've tried several times with different browsers and 7Z always returns an error when I try to unzip the downloaded file (as does gzip on Unix). The operator responded via email that it works for him and suspects the ftp client cannot handle these type of files. I've never had a problem with I.E. or Firefox downloading tar and tgz files before. Can someone else try and see if they succeed? Thanks.
This server seems very slow. I am trying to download over a T1 connection and am getting 40-90k/sec. Since the file is over 4gb that is going to take a very long time!!!! :eek: :eek: :eek: (FF3 currently says 15 hours left)

cyberdude

01-15-2009, 01:41 PM

Does anyone have a link for the 2005 Wikipedia 900,000 entry with images version?
I'll try any version that isn't TR formatted. (hence the reason I'm downloading the 4gb version)

Gregte

01-15-2009, 02:27 PM

Does anyone have a link for the 2005 Wikipedia 900,000 entry with images version?

I bought that particular version on a DVD because I have dialup internet. I think it cost $20. Don't remember the website where I ordered it either because it has been over a year ago.

cyberdude

01-15-2009, 02:46 PM

I'm trying to download the 4gb file and IE7 is downloading it and says the DL is 671mb, while FF3 says the DL is 4,767.81mb? :confused: Anyone have any idea why this might be?

lichan

01-15-2009, 04:04 PM

IE cannot download it. Use FireFox. You will need 7Z to unzip it correctly on Windows.

cyberdude

01-15-2009, 04:36 PM

IE cannot download it. Use FireFox. You will need 7Z to unzip it correctly on Windows.
My FF download stopped after DLing 367mb. It says it is complete and Izarc decompresses it
wpen0.prc
wpen10.prc
wpen100.prc - wpen110.prc

:confused: :confused:

lichan

01-15-2009, 05:25 PM

I bought that particular version on a DVD because I have dialup internet. I think it cost $20. Don't remember the website where I ordered it either because it has been over a year ago.

That website, infodisiac.com, has closed its business, commenting that Tomeraider is too full of problems for both Palm and PPC, to be worth working on any further, which is why I was trying to find a download option for it. There is a Plucker Wikipedia project on the web (projects.plkr.org) but it doesn't seem much progress has been made and no downloads are available there. There is a small Plucker Wikipedia download available at ftp.wizzy.com/pub/wizzy/palm/Wikipedia.pdb which looks pretty good with images and about 2000 articles. The downloads at pinguinburg.de/wpmp are aimed for Mobipocket but are difficult to get to work. I got them downloaded and built but I remember having a file size problem. This was just after Dmitry's SDHC release so I'll go back and see if I can get them to work on my E2 tonight. There is a no-image TomeRaider3 file available at download.wikimedia.org which works fairly well. I have not found the 900,000 entry 2005 TomeRaider3 version with images (Dec, 2005 version, 1.9 GB size, 971,747 articles, 239,810 images, filename WP_EN_PALM_IMG_195.tr3
) or the 2 volume Feb, 2007 text-only version with 1.8 million articles in 3.2 GB, that were offered on infodisiac.com.

lichan

01-15-2009, 05:28 PM

My FF download stopped after DLing 367mb. It says it is complete and Izarc decompresses it
wpen0.prc
wpen10.prc
wpen100.prc - wpen110.prc

:confused: :confused:

There are a lot more wpen*.prc files in the full download. Try again with another browser.

Gregte

01-15-2009, 07:07 PM

... I have not found the 900,000 entry 2005 TomeRaider3 version with images (Dec, 2005 version, 1.9 GB size, 971,747 articles, 239,810 images, filename WP_EN_PALM_IMG_195.tr3
...

This is exactly the one that I bought on DVD. It comes as a single file with the .tr3 extension on the filename. To make it work on the Palm you simply put the file on your card and then replace the .tr3 with .pdb.

One thing to note, don't use TomeRaider version 3.1.1 but rather use 3.1.0. The former causes some entries to not be searchable but 3.1.0 works perfectly in all regards. I have been using it for over a year, both with a 4GB SD card and now with a 16GB SDHC card. It should be noted that some 4 GB SD cards are very slow at searching Wiki while others are very fast. They can both be rated at 150X but that does not matter. I have had 2 Transcend 4GB SD cards both rated the same speed but one was much faster, the other intolerable for Wikipedia.

If you want I could burn you a copy of WP_EN_PALM_IMG_195.tr3 if you would pay postage and cost of DVD. I would not require prepayment. Just PM me if interested. At least I think my PM works.

juggernaut#2

01-16-2009, 05:09 AM

thx for all those replies, but I am solely interested in a mobipocket version of the english wikipedia which is about 1 gig in size.

(I do use the latest german 4gig wiki form WPMP project, I´d just like to have an english one for cross-reference. WPMP only hosts the whole stuff).

pruss

01-18-2009, 02:30 PM

Plucker conversion would be difficult without a ton of RAM on the desktop, because all the Plucker converters like to keep just about everything in RAM while converting, and require rather more RAM when converting than the total html filesize in my experience. One would need to modify a Plucker converter to handle wikipedia well.

lichan

01-19-2009, 01:23 PM

My FF download stopped after DLing 367mb. It says it is complete and Izarc decompresses it
wpen0.prc
wpen10.prc
wpen100.prc - wpen110.prc

:confused: :confused:

I got it to download correctly one time out of about 10. Most of the time it stops before getting the entire file. Other times the size is correct but contains errors that keep it from uncompressing completely. Its a gzip of a Unix tar file. 7-zip will uncompress it on Windows if it is error-free , once to get to the tar file and again to get to the wpen files of which there are 160 (wpen.prc, wpen0.prc through wpen154.prc and 4 index files, wpen1i.prc through wpen4i.prc) that total a whopping 5.26 GB. I have not gotten them all to load onto my 8GB card yet (Card Export and/or Windows stops before transferring them all) but MobiReader can't load any of them on my E2 because of limited memory. TXes and LifeDrives may be able to use it but it's too much storage to be really useful to me. I'll stick with the all-text TR3 and small Plucker versions I mentioned in an earlier post and I took Gregte up on his offer to mail a DVD of his 2005 version.

lichan

01-21-2009, 08:31 AM

Another option besides Plucker/Plucker Destop is IsiloX wihch puts websites/text documents into Isilo format. Besides the problems Dr. Pruss mentions concerning Plucker conversion, Plucker Desktop (the Windows-based conversion tool) is not very robust and failed with an invalid character on the first website I tried it on. IsiloX successfully converted that website on an old machine with little memory and a slow processor. How long it would take on Wikipedia, how large the result would be, and if it could be used successfully on the current crop of Palms (i.e. E2, TX, LD, Treo/Centro) is anyone's guess.

cyberdude

01-21-2009, 08:47 AM

I got it to download correctly one time out of about 10. Most of the time it stops before getting the entire file. Other times the size is correct but contains errors that keep it from uncompressing completely. Its a gzip of a Unix tar file. 7-zip will uncompress it on Windows if it is error-free , once to get to the tar file and again to get to the wpen files of which there are 160 (wpen.prc, wpen0.prc through wpen154.prc and 4 index files, wpen1i.prc through wpen4i.prc) that total a whopping 5.26 GB. I have not gotten them all to load onto my 8GB card yet (Card Export and/or Windows stops before transferring them all) but MobiReader can't load any of them on my E2 because of limited memory. TXes and LifeDrives may be able to use it but it's too much storage to be really useful to me. I'll stick with the all-text TR3 and small Plucker versions I mentioned in an earlier post and I took Gregte up on his offer to mail a DVD of his 2005 version.
I tried downloading again and after several tries it is at 87% done or a little of 4gb. It should finish in about 3 hours.

While I'm at it does anybody know what the difference is between the two files in that directory. they are the same size with a date about 1 week apart.
<cyberdude crosses his fingers and toes>