Archives/gnosygnu_xowa
1
0
Fork 0
mirror of https://github.com/gnosygnu/xowa.git synced 2026-03-02 03:49:30 +00:00
Code Issues Projects Releases Wiki Activity

$version_number

Browse Source
This commit is contained in:
gnosygnu
2016-04-24 22:08:28 -04:00
parent 07a20562a0
commit eb72d05541
15 changed files with 1441 additions and 366 deletions
Download Patch File Download Diff File Expand all files Collapse all files

199
home/wiki/Blog/2016-04.html
View File

@@ -49,76 +49,195 @@
</div>
<ul>
<li class="toclevel-1 tocsection-1">
<a href="#Release:_v3.4.3.1_.282016-04-17_21:00_Sun.29"><span class="tocnumber">1</span> <span class="toctext">Release: v3.4.3.1 (2016-04-17 21:00 Sun)</span></a>
<a href="#Release:_v3.4.4.1_.282016-04-24_19:30_Sun.29"><span class="tocnumber">1</span> <span class="toctext">Release: v3.4.4.1 (2016-04-24 19:30 Sun)</span></a>
<ul>
<li class="toclevel-2 tocsection-2">
<a href="#.28Android.29_XOWA_Android_app_on_Play_Store"><span class="tocnumber">1.1</span> <span class="toctext">(Android) XOWA Android app on Play Store</span></a>
<a href="#.28Package.29_Update_German_wikis_.282016-04.29:_https:.2F.2Farchive.org.2Fdetails.2FXowa_dewiki_latest"><span class="tocnumber">1.1</span> <span class="toctext">(Package) Update German wikis (2016-04):</span></a> <a href="https://archive.org/details/Xowa_dewiki_latest" rel="nofollow" class="external free">https://archive.org/details/Xowa_dewiki_latest</a>
</li>
<li class="toclevel-2 tocsection-3">
<a href="#.28Android.29_Kit-Kat_support_for_Android_app"><span class="tocnumber">1.2</span> <span class="toctext">(Android) Kit-Kat support for Android app</span></a>
<a href="#.28Android.29_Fix_for_missing_file-user.xowa_database"><span class="tocnumber">1.2</span> <span class="toctext">(Android) Fix for missing file-user.xowa database</span></a>
</li>
<li class="toclevel-2 tocsection-4">
<a href="#.28Desktop.29_Minor_changes_and_fixes.2C_including_missing_random_sub-pages_in_Portal.2C_missing_Wikis_sidebar_in_home_wiki_and_no_.7B.7BDisplayTitle.7D.7D"><span class="tocnumber">1.3</span> <span class="toctext">(Desktop) Minor changes and fixes, including missing random sub-pages in Portal, missing Wikis sidebar in home wiki and no {{DisplayTitle}}</span></a>
<a href="#.28Desktop.29_Minor_parser_changes_and_fixes.2C_including_using_non-ASCII_strings_for_gsub_find"><span class="tocnumber">1.3</span> <span class="toctext">(Desktop) Minor parser changes and fixes, including using non-ASCII strings for gsub find</span></a>
</li>
<li class="toclevel-2 tocsection-5">
<a href="#.28Desktop.29_New_http:.2F.2Fxowa.org_domain_with_entire_home_wiki"><span class="tocnumber">1.4</span> <span class="toctext">(Desktop) New</span></a> <a href="http://xowa.org" rel="nofollow" class="external free">http://xowa.org</a> domain with entire home wiki
</li>
<li class="toclevel-2 tocsection-6">
<a href="#Next_release:_v3.4.4"><span class="tocnumber">1.5</span> <span class="toctext">Next release: v3.4.4</span></a>
<a href="#Next_release:_v3.5.1"><span class="tocnumber">1.4</span> <span class="toctext">Next release: v3.5.1</span></a>
</li>
</ul>
</li>
<li class="toclevel-1 tocsection-7">
<a href="#Patch:_Missing_wikis_in_sidebar_.282016-04-13_21:34_Wed.29"><span class="tocnumber">2</span> <span class="toctext">Patch: Missing wikis in sidebar (2016-04-13 21:34 Wed)</span></a>
</li>
<li class="toclevel-1 tocsection-8">
<a href="#Release:_v3.4.2.1_.282016-04-10_21:00_Sun.29"><span class="tocnumber">3</span> <span class="toctext">Release: v3.4.2.1 (2016-04-10 21:00 Sun)</span></a>
<li class="toclevel-1 tocsection-6">
<a href="#Release:_v3.4.3.1_.282016-04-17_21:00_Sun.29"><span class="tocnumber">2</span> <span class="toctext">Release: v3.4.3.1 (2016-04-17 21:00 Sun)</span></a>
<ul>
<li class="toclevel-2 tocsection-7">
<a href="#.28Android.29_XOWA_Android_app_on_Play_Store"><span class="tocnumber">2.1</span> <span class="toctext">(Android) XOWA Android app on Play Store</span></a>
</li>
<li class="toclevel-2 tocsection-8">
<a href="#.28Android.29_Kit-Kat_support_for_Android_app"><span class="tocnumber">2.2</span> <span class="toctext">(Android) Kit-Kat support for Android app</span></a>
</li>
<li class="toclevel-2 tocsection-9">
<a href="#.28Desktop.29_Faster_search_database_build"><span class="tocnumber">3.1</span> <span class="toctext">(Desktop) Faster search database build</span></a>
<a href="#.28Desktop.29_Minor_changes_and_fixes.2C_including_missing_random_sub-pages_in_Portal.2C_missing_Wikis_sidebar_in_home_wiki_and_no_.7B.7BDisplayTitle.7D.7D"><span class="tocnumber">2.3</span> <span class="toctext">(Desktop) Minor changes and fixes, including missing random sub-pages in Portal, missing Wikis sidebar in home wiki and no {{DisplayTitle}}</span></a>
</li>
<li class="toclevel-2 tocsection-10">
<a href="#.28Desktop.29_New_English_Wikipedia_images_update_.282016-03.29"><span class="tocnumber">3.2</span> <span class="toctext">(Desktop) New English Wikipedia images update (2016-03)</span></a>
<a href="#.28Desktop.29_New_http:.2F.2Fxowa.org_domain_with_entire_home_wiki"><span class="tocnumber">2.4</span> <span class="toctext">(Desktop) New</span></a> <a href="http://xowa.org" rel="nofollow" class="external free">http://xowa.org</a> domain with entire home wiki
</li>
<li class="toclevel-2 tocsection-11">
<a href="#.28Desktop.29_Minor_Wikia_parser_tags"><span class="tocnumber">3.3</span> <span class="toctext">(Desktop) Minor Wikia parser tags</span></a>
</li>
<li class="toclevel-2 tocsection-12">
<a href="#.28Android.29_New_pages_for_.22Import_new_wiki.22_and_.22XOWA_Wikis.22"><span class="tocnumber">3.4</span> <span class="toctext">(Android) New pages for "Import new wiki" and "XOWA Wikis"</span></a>
</li>
<li class="toclevel-2 tocsection-13">
<a href="#.28Android.29_Minor_fixes_for_crashes_.2F_obsoleted_items"><span class="tocnumber">3.5</span> <span class="toctext">(Android) Minor fixes for crashes / obsoleted items</span></a>
</li>
<li class="toclevel-2 tocsection-14">
<a href="#Next_release:_v3.4.3"><span class="tocnumber">3.6</span> <span class="toctext">Next release: v3.4.3</span></a>
<a href="#Next_release:_v3.4.4"><span class="tocnumber">2.5</span> <span class="toctext">Next release: v3.4.4</span></a>
</li>
</ul>
</li>
<li class="toclevel-1 tocsection-15">
<a href="#Release:_v3.4.1.1_.282016-04-04_20:00_Sun.29"><span class="tocnumber">4</span> <span class="toctext">Release: v3.4.1.1 (2016-04-04 20:00 Sun)</span></a>
<li class="toclevel-1 tocsection-12">
<a href="#Patch:_Missing_wikis_in_sidebar_.282016-04-13_21:34_Wed.29"><span class="tocnumber">3</span> <span class="toctext">Patch: Missing wikis in sidebar (2016-04-13 21:34 Wed)</span></a>
</li>
<li class="toclevel-1 tocsection-13">
<a href="#Release:_v3.4.2.1_.282016-04-10_21:00_Sun.29"><span class="tocnumber">4</span> <span class="toctext">Release: v3.4.2.1 (2016-04-10 21:00 Sun)</span></a>
<ul>
<li class="toclevel-2 tocsection-14">
<a href="#.28Desktop.29_Faster_search_database_build"><span class="tocnumber">4.1</span> <span class="toctext">(Desktop) Faster search database build</span></a>
</li>
<li class="toclevel-2 tocsection-15">
<a href="#.28Desktop.29_New_English_Wikipedia_images_update_.282016-03.29"><span class="tocnumber">4.2</span> <span class="toctext">(Desktop) New English Wikipedia images update (2016-03)</span></a>
</li>
<li class="toclevel-2 tocsection-16">
<a href="#.28Desktop.29_Fixes_for_old_.sqlite3_wikis"><span class="tocnumber">4.1</span> <span class="toctext">(Desktop) Fixes for old .sqlite3 wikis</span></a>
<a href="#.28Desktop.29_Minor_Wikia_parser_tags"><span class="tocnumber">4.3</span> <span class="toctext">(Desktop) Minor Wikia parser tags</span></a>
</li>
<li class="toclevel-2 tocsection-17">
<a href="#.28Desktop.29_Fix_for_offline_import_of_large_wikis"><span class="tocnumber">4.2</span> <span class="toctext">(Desktop) Fix for offline import of large wikis</span></a>
<a href="#.28Android.29_New_pages_for_.22Import_new_wiki.22_and_.22XOWA_Wikis.22"><span class="tocnumber">4.4</span> <span class="toctext">(Android) New pages for "Import new wiki" and "XOWA Wikis"</span></a>
</li>
<li class="toclevel-2 tocsection-18">
<a href="#.28Desktop.29_Command_to_shrink_English_Wikipedia_images_by_8_GB"><span class="tocnumber">4.3</span> <span class="toctext">(Desktop) Command to shrink English Wikipedia images by 8 GB</span></a>
<a href="#.28Android.29_Minor_fixes_for_crashes_.2F_obsoleted_items"><span class="tocnumber">4.5</span> <span class="toctext">(Android) Minor fixes for crashes / obsoleted items</span></a>
</li>
<li class="toclevel-2 tocsection-19">
<a href="#.28Package.29_Release_of_French_Wikipedia_2016-03"><span class="tocnumber">4.4</span> <span class="toctext">(Package) Release of French Wikipedia 2016-03</span></a>
</li>
<li class="toclevel-2 tocsection-20">
<a href="#Next_release:_v3.4.2"><span class="tocnumber">4.5</span> <span class="toctext">Next release: v3.4.2</span></a>
<a href="#Next_release:_v3.4.3"><span class="tocnumber">4.6</span> <span class="toctext">Next release: v3.4.3</span></a>
</li>
</ul>
</li>
<li class="toclevel-1 tocsection-21">
<a href="#Release:_NONE_.282016-04-03_22:00_Sun.29"><span class="tocnumber">5</span> <span class="toctext">Release: NONE (2016-04-03 22:00 Sun)</span></a>
<li class="toclevel-1 tocsection-20">
<a href="#Release:_v3.4.1.1_.282016-04-04_20:00_Sun.29"><span class="tocnumber">5</span> <span class="toctext">Release: v3.4.1.1 (2016-04-04 20:00 Sun)</span></a>
<ul>
<li class="toclevel-2 tocsection-21">
<a href="#.28Desktop.29_Fixes_for_old_.sqlite3_wikis"><span class="tocnumber">5.1</span> <span class="toctext">(Desktop) Fixes for old .sqlite3 wikis</span></a>
</li>
<li class="toclevel-2 tocsection-22">
<a href="#.28Desktop.29_Fix_for_offline_import_of_large_wikis"><span class="tocnumber">5.2</span> <span class="toctext">(Desktop) Fix for offline import of large wikis</span></a>
</li>
<li class="toclevel-2 tocsection-23">
<a href="#.28Desktop.29_Command_to_shrink_English_Wikipedia_images_by_8_GB"><span class="tocnumber">5.3</span> <span class="toctext">(Desktop) Command to shrink English Wikipedia images by 8 GB</span></a>
</li>
<li class="toclevel-2 tocsection-24">
<a href="#.28Package.29_Release_of_French_Wikipedia_2016-03"><span class="tocnumber">5.4</span> <span class="toctext">(Package) Release of French Wikipedia 2016-03</span></a>
</li>
<li class="toclevel-2 tocsection-25">
<a href="#Next_release:_v3.4.2"><span class="tocnumber">5.5</span> <span class="toctext">Next release: v3.4.2</span></a>
</li>
</ul>
</li>
<li class="toclevel-1 tocsection-26">
<a href="#Release:_NONE_.282016-04-03_22:00_Sun.29"><span class="tocnumber">6</span> <span class="toctext">Release: NONE (2016-04-03 22:00 Sun)</span></a>
</li>
</ul>
</div>
<h2>
<span class="mw-headline" id="Release:_v3.4.4.1_.282016-04-24_19:30_Sun.29">Release: v3.4.4.1 (2016-04-24 19:30 Sun)</span>
</h2>
<p>
The desktop app is a trivial release. It has a few minor parser fixes, primarily for German Wikipedia.
</p>
<p>
The Android app is a minor release. It has one significant fix for not requiring one database: file-xowa. This will only be necessary for the German wikis
</p>
<h3>
<span class="mw-headline" id=".28Package.29_Update_German_wikis_.282016-04.29:_https:.2F.2Farchive.org.2Fdetails.2FXowa_dewiki_latest">(Package) Update German wikis (2016-04): <a href="https://archive.org/details/Xowa_dewiki_latest" rel="nofollow" class="external free">https://archive.org/details/Xowa_dewiki_latest</a></span>
</h3>
<p>
I updated the German wikis this week. You can find them at <a href="https://archive.org/details/Xowa_dewiki_latest" rel="nofollow" class="external free">https://archive.org/details/Xowa_dewiki_latest</a> Note the following:
</p>
<ul>
<li>
The images are an update to the 2015-09 set. If you already have the 2015-09 set, just download the 2016-04 update: <a href="https://archive.org/download/Xowa_dewiki_latest/Xowa_dewiki_2016-04-07_file_update.7z" rel="nofollow" class="external free">https://archive.org/download/Xowa_dewiki_latest/Xowa_dewiki_2016-04-07_file_update.7z</a>
</li>
<li>
For Android, download all the de.wikipedia.org files in <a href="http://xowa.org/home/wiki/Android/Setup.html" id="xolnki_7" title="Android/Setup" class="xowa-visited">Android/Setup</a>
</li>
<li>
For the other German wikis, the process is similar. Download <a href="https://archive.org/download/Xowa_dewiki_latest/Xowa_debundle_2016-04-07.7z" rel="nofollow" class="external free">https://archive.org/download/Xowa_dewiki_latest/Xowa_debundle_2016-04-07.7z</a> and copy the files to your microSD card.
</li>
</ul>
<h3>
<span class="mw-headline" id=".28Android.29_Fix_for_missing_file-user.xowa_database">(Android) Fix for missing file-user.xowa database</span>
</h3>
<p>
The Android app would crash if it was missing this database: *-file-user.xowa. See <a href="https://github.com/gnosygnu/xowa/issues/36#issuecomment-172292021" rel="nofollow" class="external free">https://github.com/gnosygnu/xowa/issues/36#issuecomment-172292021</a> .
</p>
<p>
Here's the short version:
</p>
<ul>
<li>
If you are planning to use the German wikis, or want to be prepared for future dumps (English Wiktionary), you should install v3.4.4.
</li>
</ul>
<p>
Here's the long version:
</p>
<ul>
<li>
XOWA desktop allows you to download the original versions of images for offline viewing
<ul>
<li>
You can download these original versions by clicking on any image in an article
</li>
<li>
These images are stored in a file like en.wikipedia.org-file-user.xowa
</li>
</ul>
</li>
<li>
XOWA's file database system requires that this database is always present.
<ul>
<li>
If the file-user.xowa is not present, XOWA creates one automatically.
</li>
</ul>
</li>
<li>
All XOWA packages on archive.org do not include file-user.xowa
<ul>
<li>
I don't include this file, because I don't want to overwrite a pre-existing file-user.xowa when a user upgrades to a new package.
</li>
<li>
I was relying on the auto-create mechanism to create a file-user.xowa.
</li>
</ul>
</li>
<li>
However, on Android, all apps have extremely limited write permissions. On an external SD card, they can only write to one directory: /&lt;sd_card_mount&gt;/Android/data/&lt;package_name&gt;
</li>
<li>
If there was no file-user.xowa, XOWA Android tried to create it. Because of the limited write permissions, it crashed when it couldn't do so.
</li>
</ul>
<p>
v3.4.4 still tries to create the file-user.xowa file, but no longer crashes if it can't.
</p>
<h3>
<span class="mw-headline" id=".28Desktop.29_Minor_parser_changes_and_fixes.2C_including_using_non-ASCII_strings_for_gsub_find">(Desktop) Minor parser changes and fixes, including using non-ASCII strings for gsub find</span>
</h3>
<p>
These are a bunch of minor parser fixes for German Wikipedia. They affect a small number of pages (&lt;100) and don't affect content. The most interesting item is that it required another change to <a href="https://sourceforge.net/projects/luaj/" rel="nofollow" class="external text">LuaJ</a>. It mistakenly disregarded UTF8 byte encoding for bytes between 128 and 255. This caused gsub and similar calls to fail when using non-ASCII characters, like "ß"
</p>
<h3>
<span class="mw-headline" id="Next_release:_v3.5.1">Next release: v3.5.1</span>
</h3>
<p>
I'm working on a new wiki update tool which will make setting up the databases much easier on Android.
</p>
<p>
For wikis, I'm going to update the rest of the English wikis. I'm also going to try to fit French in.
</p>
<p>
<br>
</p>
<h2>
<span class="mw-headline" id="Release:_v3.4.3.1_.282016-04-17_21:00_Sun.29">Release: v3.4.3.1 (2016-04-17 21:00 Sun)</span>
</h2>
@@ -145,7 +264,7 @@
<b>Youtube video</b>: <a href="https://www.youtube.com/watch?v=jsMTBxGweUw" rel="nofollow" class="external free">https://www.youtube.com/watch?v=jsMTBxGweUw</a>
</li>
<li>
<b>Android Setup</b>: <a href="http://xowa.org/home/wiki/Android/Setup.html" id="xolnki_7" title="Android/Setup" class="xowa-visited">Android/Setup</a>
<b>Android Setup</b>: <a href="http://xowa.org/home/wiki/Android/Setup.html" id="xolnki_8" title="Android/Setup" class="xowa-visited">Android/Setup</a>
</li>
</ul>
<p>
@@ -269,7 +388,7 @@
<b>Really benefits from an SSD</b>: SQLite really does better with an SSD. I tried some tricks like changing PRAGMA synchronous to OFF, but this only shaves off a dozen or so minutes. In contrast, an SSD will easily knock off an hour if not more (from 2 hours to about 40 min)
</li>
<li>
<b>If you want the new search, downloading from archive.org is the easiest way</b>: There are other complexities with the search database rebuild (PageRank algorithm and the 10 GB pagelinks dump: See <a href="http://xowa.org/home/wiki/App/Search/Overview.html" id="xolnki_8" title="App/Search/Overview" class="xowa-visited">App/Search/Overview</a>). As such, the easiest way is to download prebuilt copies from archive.org:
<b>If you want the new search, downloading from archive.org is the easiest way</b>: There are other complexities with the search database rebuild (PageRank algorithm and the 10 GB pagelinks dump: See <a href="http://xowa.org/home/wiki/App/Search/Overview.html" id="xolnki_9" title="App/Search/Overview" class="xowa-visited">App/Search/Overview</a>). As such, the easiest way is to download prebuilt copies from archive.org:
<ul>
<li>
<a href="https://archive.org/download/Xowa_enwiki_latest/Xowa_enwiki_2016-03-05_wiki_core.7z" rel="nofollow" class="external free">https://archive.org/download/Xowa_enwiki_latest/Xowa_enwiki_2016-03-05_wiki_core.7z</a>
@@ -294,7 +413,7 @@
<b>New user</b>: Download the new 2016-03 version. Previously you would have to download 2015-06 set, and then download separate updates for every month between 2015-07 and 2016-03. This was just too cumbersome.
</li>
<li>
<b>Existing user (2015-06)</b>: Ignore the 2016-03 version. You downloaded the 2015-06 set and presumably have been keeping up with the monthly updates. The 2016-03 set is the same as your set, except it is smaller (it no longer has deleted images). If you want to remove about 8 GB of deleted images, see <a href="http://xowa.org/home/wiki/Dashboard/Files/Deletion.html" id="xolnki_9" title="Dashboard/Files/Deletion" class="xowa-visited">Dashboard/Files/Deletion</a>. Once you remove the deleted images, you will have a set that is exactly the same as the 2016-03 version.
<b>Existing user (2015-06)</b>: Ignore the 2016-03 version. You downloaded the 2015-06 set and presumably have been keeping up with the monthly updates. The 2016-03 set is the same as your set, except it is smaller (it no longer has deleted images). If you want to remove about 8 GB of deleted images, see <a href="http://xowa.org/home/wiki/Dashboard/Files/Deletion.html" id="xolnki_10" title="Dashboard/Files/Deletion" class="xowa-visited">Dashboard/Files/Deletion</a>. Once you remove the deleted images, you will have a set that is exactly the same as the 2016-03 version.
</li>
<li>
<b>Existing user (2013-11 or something else)</b>: Download the 2016-03 version. You have an old set of XOWA image databases that I really can't support any longer (they have an extension of .sqlite3). I know downloading 80 GB is painful, but I'm not planning to change database formats again in the future.
@@ -386,7 +505,7 @@
The total size of English Wikipedia is about 90 GB. 8 GB is from old images: images removed from articles during the day-to-day editing churn.
</p>
<p>
If you have English Wikipedia and have been following along with the updates, go to <a href="http://xowa.org/home/wiki/Dashboard/Files/Deletion.html" id="xolnki_10" title="Dashboard/Files/Deletion" class="xowa-visited">Dashboard/Files/Deletion</a> and follow the instructions therein.
If you have English Wikipedia and have been following along with the updates, go to <a href="http://xowa.org/home/wiki/Dashboard/Files/Deletion.html" id="xolnki_11" title="Dashboard/Files/Deletion" class="xowa-visited">Dashboard/Files/Deletion</a> and follow the instructions therein.
</p>
<h3>
<span class="mw-headline" id=".28Package.29_Release_of_French_Wikipedia_2016-03">(Package) Release of French Wikipedia 2016-03</span>