100MB Encyclopedia for your CF - Wikipedia!

[KenSong]

The world's largest free encyclopedia, Wikipedia, is now available in TomeRaider format and can be used on Pocket PC and Palm OS devices. Wikipedia is a project to create a complete and accurate open content encyclopedia. The English version measures 100 MB and contains 230 MB of text.

I have downloaded this and the entries are impressive. I have yet to find a topic missing. Topics are hyperlinked.

While I can enjoy this on my PC, I fail to convert this into a Palm PDB. Maybe it's just too big but it has been done for PocketPC. Here's the challenge ;P Anyone here can successfuilly convert this? You'll need TomeRaider v2.8. It'll help put your new CF to good use ;)

Here's the link.
http://members.chello.nl/epzachte/Wikipedia/

[crh3f]

too bad the NR doesn't have a CF slot, dude...talk to the NXers...

[KenSong]

Yes, I just realised I posted in the Forum. Thanks for pointing that out. I'll repost ;P

[crh3f]

No problem :)

[saw9000]

I have better than 100 MB free, and I have some time free, so I'll give it a try. However, the site says that TomeRaider won't see files of greater than 30 MB in size. We'll just see about that...
Scott

[pruss]

I bet Plucker can convert it, and it tends to have very good compression ratios.

[KenSong]

I thought I'd try with iSilo over the weekend but realised it may be too big since it'll not be compressed. :(

It's stated at the website that they'll try to split the files and removed some entries. Will take a couple of weeks so there's hope yet.

[KenSong]

Originally posted by saw9000
I have better than 100 MB free, and I have some time free, so I'll give it a try. However, the site says that TomeRaider won't see files of greater than 30 MB in size. We'll just see about that...
Scott

I tried that too, but at 70% of the conversion, it quit and the pdb file I found in my Install folder is 0K :(

TomeRaider support would not admit the limit stating in their FAQ the largest file size is not known. I wonder if this is a limit of the PalmOS itself.

[saw9000]

Well, I gave it a try, but it didn't work well. Apparently, the latest version of TR for Windows doesn't play nicely with XP. When I tried to upgrade the file to the format used by the latest version of TomeRaider (2.8 and up), I got an, "...unknown error while accessing the unnamed file." I'm not sure how much more vague it gets than that.
Scott

[saw9000]

I was composing my reply when you posted yours, Ken. I left the browser window open while I was downloading and converting, or perhaps attempting to convert.
I am pretty sure that the limit has nothing to do with the Palm OS. The largest file size technically addressable with the OS is around 4 GB. I forget how it gets there, but that's the number I've read.
Scott
Scott

[pruss]

4gb = 2^32. That's no doubt the explanation.

[icruise]

I use dictonary programs of around 90MB, so the size shouldn't be a problem for the Palm OS in general.

[saw9000]

Which dictionary program is that?
Scott

[Bill]

nonsense - you cannot read a file greater than 30mb - that is the current restriction. there are workarounds, but these are not "pdb" or "prc" files themselves.

[icruise]

I use WDIC -- iit is a Japanese dictionary reader for PDIC format dictionaries. The files are not PDB files, it's true, so I don't know if that affects it. But my point is that I don't have any trouble searching these dictionaries (I also have some large Japanese encyclopedias that I use on the Clie as well), so one would think they could come up with a solution.

[SirOops]

Is this dictionary really larger than 30 Mb ? Please be specific.
Maybe the contents is > 30 Mb, not the file size.

Your file is probably compressed, as TomeRaider files are.
The Wikipedia file is 100 Mb but contains 230 Mb text.

[Tixx]

I would like to see this work:)

[mvklein]

I am using a 61 MB iSilo .pdb file without a problem so clearly the file size limit is larger.

[cepler]

Originally posted by pruss
4gb = 2^32. That's no doubt the explanation.

No no no!  People, lets keep our units straight!

http://physics.nist.gov/cuu/Units/binary.html

[icruise]

The dictionary files I use are 90MB or more as reported in the finder (on my Mac).

[Badandy]

anybody get it done yet?

[labete]

where can i find the french version ??? (if there is one)

[SirOops]

Labete, if you can help to translate the introduction page to french, only a few sentences, I will prepare a french version.
You can contact me on xxx@chello.nl
read xxx as epzachte (to avoid spam)

First I will need to complete the script modifications for Palm version of TomeRaider, which does not support html yet (next major release, TR 3, will but may still be half a year away).

[SirOops]

Oh I forgot to mention the Wikipedia is now split into several volumes, each less than 25 Mb. Loading has been succesful on a Handera 330 (Palm Os 3.x)

Now the html problem remains (html is not officially supported in TR for PPC, just happens to work)

Without html some articles will suffer, especially tables will look strange, but keep in mind this will only be an intermediate solution till TR3.

The author of TomeRaider will do his best to make Wikipedia look as good as on PPC in the next release, he promised.

[SirOops]

You can take a look at the online Wikipedia at http://www.wikipedia.org

[KongK]

Originally posted by SirOops
Oh I forgot to mention the Wikipedia is now split into several volumes, each less than 25 Mb. Loading has been succesful on a Handera 330 (Palm Os 3.x)


Hi, does anyone know where to download the files?

Cheers.

[SirOops]

I will upload the files to www.wikipedia.org when the html has been edited out. Right now they are unreadable. Will take about ten days.

I will post here when files are available.

[francis]

just wanted to post to get an e-mail when you smarties figure this one out. Is there a way to get e-mial notification from a thread even if you have nothing to add? Francis

[SirOops]

A special version of the Wikipedia database for Palm users is now available. See for details http://members.ams.chello.nl/epzachte/Wikipedia

[jtumavit]

Originally posted by francis
just wanted to post to get an e-mail when you smarties figure this one out. Is there a way to get e-mial notification from a thread even if you have nothing to add? Francis

Hit "Subscribe to this Thread" at the bottom of the page.

[SirOops]

New release of of Wikipedia for Palm now available.
6 TomeRaider files, consumes 120 Mb (card) memory, but contains now 310 Mb text in 140.000 articles.
Next release planned for october.

Much more at http://members.chello.nl/epzachte/Wikipedia

English Wikipedia http://www.wikipedia.org