<spanclass="mw-headline"id="Patch:_Missing_wikis_in_sidebar_.282016-04-13_21:34_Wed.29">Patch: Missing wikis in sidebar (2016-04-13 21:34 Wed)</span>
</h2>
<p>
This is a patch for a defect in v3.4.2.1.
</p>
<p>
v3.4.2.1 updated the CSS for the home wiki to fix a narrow search box. See <ahref="https://github.com/gnosygnu/xowa/issues/54"rel="nofollow"class="external free">https://github.com/gnosygnu/xowa/issues/54</a>
</p>
<p>
Unfortunately, this CSS also removed the wiki sidebar in the home wiki. I didn't notice this until yesterday.
</p>
<p>
The patch updates one file: /xowa/bin/any/xowa/cfg/app/xowa.gfs . Just replace your version with it.
</p>
<p>
You can also change this manually by finding the div_logo snippet and updating with the snippet below.
</p>
<p>
This will be part of the next release. I didn't want to release an entire new version for a one-line text-file fix.
<div class="portal"><h3></h3></div><!-- empty heading else wikipedia css will hide next <h3> after <div id='p-logo'>; DATE:2016-04-12-->
As per <ahref="https://github.com/gnosygnu/xowa/issues/53"rel="nofollow"class="external free">https://github.com/gnosygnu/xowa/issues/53</a> William was unable to build the new search databases on his machine. I tried it on an older dev machine, and found that it could take upwards of 5 hours to complete.
</p>
<p>
I optimized some of the SQL code and reduced it to about 2 hours. That said, note the following:
</p>
<ul>
<li>
<b>Fails on my 32-bit Windows XP dev machine</b>: I don't know why. The same build works on 2 Windows 7 64-bit machines, 1 openSUSE Linux 64-bit machine, and 1 Mac OS X 64-bit machine. It also works on the 32-bit JVM on the Windows 7 64-bit machine. However, the lone 32-bit Windows machine fails, and fails in a very strange way (it fails silently in release mode, and hangs in debug mode). I'm going to hope this is the non-dominant behavior, and reinvestigate at a later point in time.
</li>
<li>
<b>Really benefits from an SSD</b>: SQLite really does better with an SSD. I tried some tricks like changing PRAGMA synchronous to OFF, but this only shaves off a dozen or so minutes. In contrast, an SSD will easily knock off an hour if not more (from 2 hours to about 40 min)
</li>
<li>
<b>If you want the new search, downloading from archive.org is the easiest way</b>: There are other complexities with the search database rebuild (PageRank algorithm and the 10 GB pagelinks dump: See [[App/Search/Overview]]). As such, the easiest way is to download prebuilt copies from archive.org:
<spanclass="mw-headline"id=".28Desktop.29_New_English_Wikipedia_images_update_.282016-03.29">(Desktop) New English Wikipedia images update (2016-03)</span>
</h3>
<p>
I uploaded new consolidated versions of English Wikipedia images (2016-03) to archive.org. See <ahref="https://archive.org/details/Xowa_enwiki_latest"rel="nofollow"class="external free">https://archive.org/details/Xowa_enwiki_latest</a>.
</p>
<p>
In terms of usage, pick one of the following:
</p>
<ul>
<li>
<b>New user</b>: Download the new 2016-03 version. Previously you would have to download 2015-06 set, and then download separate updates for every month between 2015-07 and 2016-03. This was just too cumbersome.
</li>
<li>
<b>Existing user (2015-06)</b>: Ignore the 2016-03 version. You downloaded the 2015-06 set and presumably have been keeping up with the monthly updates. The 2016-03 set is the same as your set, except it is smaller (it no longer has deleted images). If you want to remove about 8 GB of deleted images, see [[Dashboard/Files/Deletion]]. Once you remove the deleted images, you will have a set that is exactly the same as the 2016-03 version.
</li>
<li>
<b>Existing user (2013-11 or something else)</b>: Download the 2016-03 version. You have an old set of XOWA image databases that I really can't support any longer (they have an extension of .sqlite3). I know downloading 80 GB is painful, but I'm not planning to change database formats again in the future.
</li>
</ul>
<p>
Finally, after I release XOWA Beta for Android, I'm going to work on a new update feature that will more gracefully handle monthly updates. In the meantime, please bear with the manual process.
</p>
<p>
<br>
</p>
<h3>
<spanclass="mw-headline"id=".28Desktop.29_Minor_Wikia_parser_tags">(Desktop) Minor Wikia parser tags</span>
</h3>
<p>
A user requested some parser functionality for Wikia wikis (see <ahref="https://en.wikipedia.org/wiki/User_talk:Gnosygnu">https://en.wikipedia.org/wiki/User_talk:Gnosygnu</a> . This release now supports the <choose> and <tabber> extensions.
</p>
<p>
<br>
</p>
<h3>
<spanclass="mw-headline"id=".28Android.29_New_pages_for_.22Import_new_wiki.22_and_.22XOWA_Wikis.22">(Android) New pages for "Import new wiki" and "XOWA Wikis"</span>
</h3>
<p>
The last major piece for XOWA Beta was more usable screens for importing wikis and managing wikis. Both these pages are now part of the latest release:
</p>
<ul>
<li>
<b>XOWA Wikis</b>: The "XOWA" button in the left-nav now opens a page that lists all wikis. It also allows you to import a new one by pressing the "+" icon.
</li>
<li>
<b>Import new wikis</b>: The "Import" screen got a new design overhaul to make it much prettier and more intuitive. A lot of thanks goes to anonymous4 for helping with layout and feedback.
</li>
</ul>
<p>
<br>
</p>
<h3>
<spanclass="mw-headline"id=".28Android.29_Minor_fixes_for_crashes_.2F_obsoleted_items">(Android) Minor fixes for crashes / obsoleted items</span>
</h3>
<p>
There were two minor crashes that would occur when using the left-nav button. The main one was pressing "Random" when on the "Import" screen
</p>
<p>
I also removed two features: "Nearby" and "Log in to Wikipedia". Neither of these seem useful for offline XOWA, and I didn't want them taking up screen real-estate.
I'm planning on releasing XOWA Android Beta on Google Play mid-week. I'm sure that there will be spillover work that leads to another Android app update next week.
</p>
<p>
For wikis, the Wikimedia dump server is stalled again. I'm going to wait for it to resume before continuing with German Wikipedia.
The desktop app is a minor release. It has a few fixes related to old .sqlite3 wikis and offline imports.
</p>
<p>
The Android app has not been changed.
</p>
<h3>
<spanclass="mw-headline"id=".28Desktop.29_Fixes_for_old_.sqlite3_wikis">(Desktop) Fixes for old .sqlite3 wikis</span>
</h3>
<p>
As reported in <ahref="https://sourceforge.net/p/xowa/discussion/defects/thread/f142ca23/"rel="nofollow"class="external free">https://sourceforge.net/p/xowa/discussion/defects/thread/f142ca23/</a> v3.3.4 did not work for old .sqlite3 wikis. These wikis were phased out last year (in 2015-04), but I didn't want to drop support for them entirely.
</p>
<p>
v3.4.1 has 2 fixes for the following:
</p>
<ul>
<li>
<b>Open old .sqlite3 wikis</b>: Previously, XOWA would just show a blank page
</li>
<li>
<b>Allow old .sqlite3 wikis to upgrade to the new search system</b>: Previously, XOWA would keep prompting to upgrade
</li>
</ul>
<h3>
<spanclass="mw-headline"id=".28Desktop.29_Fix_for_offline_import_of_large_wikis">(Desktop) Fix for offline import of large wikis</span>
</h3>
<p>
This was reported in a separate ticket: <ahref="https://github.com/gnosygnu/xowa/issues/51"rel="nofollow"class="external free">https://github.com/gnosygnu/xowa/issues/51</a> Basically, the new search system caused offline imports to fail for large wikis. A large wiki is defined as one with a dump file of 1.5 GB.
</p>
<p>
v3.4.1 fixes this issue. I tested with English Wikisource 2016-03: <ahref="http://dumps.wikimedia.org/enwikisource/20160305/"rel="nofollow"class="external free">http://dumps.wikimedia.org/enwikisource/20160305/</a>
</p>
<h3>
<spanclass="mw-headline"id=".28Desktop.29_Command_to_shrink_English_Wikipedia_images_by_8_GB">(Desktop) Command to shrink English Wikipedia images by 8 GB</span>
</h3>
<p>
The total size of English Wikipedia is about 90 GB. 8 GB is from old images: images removed from articles during the day-to-day editing churn.
</p>
<p>
If you have English Wikipedia and have been following along with the updates, go to [[Dashboard/Files/Deletion]] and follow the instructions therein.
</p>
<h3>
<spanclass="mw-headline"id=".28Package.29_Release_of_French_Wikipedia_2016-03">(Package) Release of French Wikipedia 2016-03</span>
</h3>
<p>
I had a request to update French Wikipedia, but have been delaying it for several weeks. I updated French Wiki and uploaded it here: <ahref="https://archive.org/details/Xowa_frwiki_latest"rel="nofollow"class="external free">https://archive.org/details/Xowa_frwiki_latest</a>
The desktop app is a major release. It has a new autocomplete address bar, a new search system as well as minor parser fixes.
</p>
<p>
The Android app is a major release. It has more updates for the new search system.
</p>
<h3>
<spanclass="mw-headline"id=".28Desktop.29_New_autocomplete_address_bar">(Desktop) New autocomplete address bar</span>
</h3>
<p>
The address bar now supports autocompletion. For example, open up English Wikipedia, and start typing <code>earth</code>. The autocomplete is very fast and supports a lot of advanced functionality. For example you can do a search like <code>earth + (history, future) -middle</code> directly in the address bar. See [[App/Search/Overview]] as well as [[Options/Search suggest]].
</p>
<p>
Unfortunately, the autocomplete uses the new search system, so old wikis need to upgrade the search databases. You can upgrade by any of the following:
</p>
<ul>
<li>
Use the search suggest box
<ul>
<li>
Open any page in the wiki
</li>
<li>
Click the search suggest box (the box between "View HTML" and the magnifying glass)
</li>
<li>
Start typing. XOWA will prompt you to upgrade the wiki.
</li>
</ul>
</li>
<li>
Use the [[Dashboard/Wiki_maintenance]] page
<ul>
<li>
Go to [[Dashboard/Wiki_maintenance]]
</li>
<li>
Find your wiki in the list
</li>
<li>
Click the <code>Search</code> button in the same row
</li>
<li>
Click <code>Run Script</code>
</li>
</ul>
</li>
<li>
Download a copy (only for users with 2016-03 English Wikipedia)
<spanclass="mw-headline"id=".28Desktop.29_New_search_system">(Desktop) New search system</span>
</h3>
<p>
I completely rewrote the search system over the past several weeks. Most of these changes were meant for Android to handle fast searches with a slower processor. This new engine is now part of the desktop app, so desktop users get the same benefits as well. To summarize, here are the main benefits:
</p>
<ul>
<li>
<b>Faster searches</b>: Searches are now dramatically faster for single-words (<code>earth</code>), wildcards (<code>e*</code>), multiple words (<code>earth history</code>) and multiple wildcards (<code>earth* history*</code>)
</li>
<li>
<b>PageRank score</b>: Searches now use <ahref="https://en.wikipedia.org/wiki/PageRank">PageRank</a> to order results. These provide better quality results than using page length. The old system would show "List of" pages at the top of the page
</li>
<li>
<b>Punctuation friendly</b>: Searches can be done for <code>U.S.A.</code> or <code>USA</code>; <code>dont't</code> or <code>dont</code>; <code>half-life</code> or <code>half</code> or <code>life</code>.
</li>
<li>
<b>Boolean searches</b>: Searches can use boolean operators like <code>-</code>, <code>,</code>, <code>+</code>, <code>()</code>, and <code>*</code>. In addition, there's even an escape operator: <code>\</code>. See [[App/Search/Overview]]
</li>
<li>
<b>Home wiki</b>: The home wiki is now searchable. Try entering in <code>search</code> or any other word
</li>
</ul>
<h3>
<spanclass="mw-headline"id=".28Desktop.29_Minor_fixes_for_Category_pages_and_taxonomy_url_links">(Desktop) Minor fixes for Category pages and taxonomy url links</span>
</h3>
<p>
There are basically two fixes:
</p>
<ul>
<li>
<b>Category pages had script error</b>: 2016-03 English Wikipedia Category pages would have script errors in the top right corner of the page. For example, <ahref="https://en.wikipedia.org/wiki/Category:Articles_lacking_sources_from_February_2009">https://en.wikipedia.org/wiki/Category:Articles_lacking_sources_from_February_2009</a>
</li>
<li>
<b>Taxonomy boxes would have non-clickable links</b>: 2016-03 English Wikipedia pages on biological species have a taxonomy box at the bottom of the page. It has external links which should be clickable, but were not. For example, <ahref="https://en.wikipedia.org/wiki/Golden_eagle">https://en.wikipedia.org/wiki/Golden_eagle</a>
</li>
</ul>
<h3>
<spanclass="mw-headline"id=".28Android.29_Improvements_for_search_system">(Android) Improvements for search system</span>
</h3>
<p>
The Android search system received more performance and accuracy improvements. Also, the Android version supports boolean searches as well. If you're using the new search system, you should definitely update your copy:
</p>
<ul>
<li>
Download the new apk: <ahref="https://github.com/gnosygnu/xowa/releases"rel="nofollow"class="external free">https://github.com/gnosygnu/xowa/releases</a>
</li>
<li>
Download the new wiki databases: <ahref="https://archive.org/download/Xowa_enwiki_latest/Xowa_enwiki_2016-03-05_html_core.7z"rel="nofollow"class="external free">https://archive.org/download/Xowa_enwiki_latest/Xowa_enwiki_2016-03-05_html_core.7z</a>
</li>
</ul>
<p>
If you haven't tried XOWA on Android, please give it a try. See <ahref="https://github.com/gnosygnu/xowa/wiki/Android"rel="nofollow"class="external free">https://github.com/gnosygnu/xowa/wiki/Android</a>.
I've spent a lot of time on the search system for the past several weeks. I'm going to take a break and work on the following items for next week's release:
</p>
<ul>
<li>
<b>Shrink the image databases for English Wikipedia</b> : English Wikipedia is getting close to 128 GB but there are about 25 GB of unused image files. I'm planning on adding a feature that allows users to delete these old images. I'll also upload a brand new set.
</li>
<li>
<b>Resume image dumps</b>: I'm going to upload a new French Wikipedia.
</li>
<li>
<b>Make minor Android changes</b>: There are still some minor changes I need to make for the upcoming Google Play release in April.
I'm postponing this week's release. I'm almost done with the desktop integration of the new search system, but I still want to make a few more changes and feel that a few more days would help.
I did upload new updates for English Wikipedia this week. See <ahref="https://archive.org/download/Xowa_enwiki_latest"rel="nofollow"class="external free">https://archive.org/download/Xowa_enwiki_latest</a> and the 2016-03-05 files. I'll update the links later to point to them.
</p>
<p>
I'll try to upload a new Android release later this week. This will mostly have small tweaks for the new search system.
Again, there is no new release for the desktop app. I will make one next week, and resume wiki generation then.
</p>
<p>
The Android app is a major release. The major change is an improved search system. To get it, do the following:
</p>
<ul>
<li>
Download the new Android apk: <ahref="https://github.com/gnosygnu/xowa/releases/tag/v3.3.2.1"rel="nofollow"class="external free">https://github.com/gnosygnu/xowa/releases/tag/v3.3.2.1</a>
<ul>
<li>
Note: I changed the application ID yet again, so make sure you remove the old XOWA app, or you will have 2 XOWA apps. If you do end up with 2 of them, remove both, and reinstall v3.3.2.1 again
</li>
</ul>
</li>
<li>
Download the new core English Wikipedia files (1.2 GB): <ahref="https://archive.org/download/Xowa_enwiki_latest/Xowa_enwiki_2016-02-04_html_core_v3.7z"rel="nofollow"class="external free">https://archive.org/download/Xowa_enwiki_latest/Xowa_enwiki_2016-02-04_html_core_v3.7z</a>
</li>
</ul>
<p>
Here is a list of the changes:
</p>
<ul>
<li>
"Wikipedia Alpha" updates no longer replaces XOWA: XOWA is a fork of the Wikipedia app. I haven't changed all the Wikipedia branding and IDs. In this particular case, I had left the package name the same. Whenever "Wikipedia Alpha" pushed out a new update, Android would prompt the user to install it. Installing it would remove XOWA and replace it with the "Wikipedia Alpha".
</li>
<li>
Better performance for multi-word searches: I had to add more columns and indexes to support faster lookup for certain types of searches. For example, "earth a". Unfortunately this required updating the core English Wikipedia files again
</li>
<li>
Do not scroll to top of results when adding new results: XOWA works by finding 2 - 5 results at a time and sending them incrementally to the search window. Each send would cause the search results to scroll back to the top. This was annoying when browsing through the list while search is running.
</li>
<li>
Return 10 results by default and scroll to retrieve more results: Previously, XOWA would only return 50 results. Now, XOWA is smart enough to search for more as needed. Also, performance is improved by returning 10 instead of 50.
</li>
<li>
Return search text as first result: XOWA now uses "page rank" to sort the results. However, most times, the search term may not be the highest ranking. For example, searching for "ear" would list "earth" over "ear" because "earth" has a higher rank. Now, XOWA will list "ear" first since that is the current search text
</li>
<li>
Identify redirect articles with "→": Wikipedia uses redirects to handle items like "page renames and "misspellings". For example, "Www" redirects to "World Wide Web". XOWA better identifies these entries by showing "Www → World Wide Web"
</li>
<li>
Remove redundant redirect articles from results: Ordinarily, there can be many redirects leading to the same page. For example, "World wide web" and "World-wide web" are both redirects to "World Wide Web". Previously, searching for "world wide web" would return all three pages. Now only 1 is returned.
</li>
<li>
Search for entire word by putting space at end of search: XOWA automatically adds a wildcard to every search. For example, searching for "earth" actually searches for "earth*" which will return "Earth" and "Earthquake". However, sometimes only "Earth" is wanted, not "Earthquake". Adding a space and searching for "earth " will automatically limit the search to "Earth"
</li>
<li>
Highlight search terms in search results: XOWA was previously relying on Wikipedia code to highlight search terms. This approach was rather simple: it would highlight a term only if the exact search string was found in the text. For example, "Earth History" would correctly highlight "Museum of <strong>Earth History</strong>" but not "History of Earth". This version now highlights the second as "<strong>History</strong> of <strong>Earth</strong>"
</li>
</ul>
<p>
Again, I strongly recommend you get this version. There are a few bugs to work out, but this version is much improved over previous ones. This is the last major update for Android search, and future changes will probably not have as much of a noticeable impact -- at least until I get around to full-text search.
There is no new release for the desktop app. I'm still making major changes to the Search system and need more time for review.
</p>
<p>
The Android app is a major release. The major change is a faster search system. To get it, do the following:
</p>
<ul>
<li>
Download the new Android apk: <ahref="https://github.com/gnosygnu/xowa/releases/tag/v3.3.1.1"rel="nofollow"class="external free">https://github.com/gnosygnu/xowa/releases/tag/v3.3.1.1</a>
<ul>
<li>
Note: I changed the application ID, so make sure you remove the old XOWA app, or you will have 2 XOWA apps. If you do end up with 2 of them, remove both, and reinstall v3.3.1.1 again
</li>
</ul>
</li>
<li>
Download the new core English Wikipedia files (1.6 GB): <ahref="https://archive.org/download/Xowa_enwiki_latest/Xowa_enwiki_2016-02-04_html_core_v2.7z"rel="nofollow"class="external free">https://archive.org/download/Xowa_enwiki_latest/Xowa_enwiki_2016-02-04_html_core_v2.7z</a>
</li>
</ul>
<p>
Here is a brief summary of the advantages:
</p>
<ul>
<li>
Better performance: Search is much quicker. One word searches should come back subsecond and multiple words should come back in a few, with initial results coming back in the first second
Better ranking: Search now ranks results by <ahref="https://en.wikipedia.org/wiki/PageRank">page rank</a>. Previously, XOWA ranks by page length, which resulted in long "List of" articles appearing near the top.
Better search terms: Search now handles punctuation better. Searches can be done for "U.S.A." or "USA"; "dont't" or "dont"; "half-life" or "half" or "life".
</li>
</ul>
<p>
I'll explain these in greater detail in the next desktop release.
</p>
<p>
If you are using the Android beta, I strongly recommend you get this version. The new search is dramatically improved and well worth the effort.
Another week, another postponement. My apologies, but I'm usually very cautious when making database changes -- especially since it's pretty important to get things right the first time. I'm going to try for a Thursday release, but may fall back on next Sunday.
</p>
<p>
I did upload the new Android English Wikipedia for 2016-02 this week. The new urls are at <ahref="https://github.com/gnosygnu/xowa/issues/36#issuecomment-172428070"rel="nofollow"class="external free">https://github.com/gnosygnu/xowa/issues/36#issuecomment-172428070</a> .
I'm skipping the release this week also. I've made some good progress with search, and have a prototype that is significantly faster than the existing version. However, it'll take me another week before I add it to Android and probably two weeks before the desktop.
</p>
<p>
I uploaded the image update for English Wikipedia 2016-02 this week. You can grab the latest at <ahref="https://archive.org/download/Xowa_enwiki_latest/Xowa_enwiki_2016-02-03_file_v2b.7z"rel="nofollow"class="external free">https://archive.org/download/Xowa_enwiki_latest/Xowa_enwiki_2016-02-03_file_v2b.7z</a> My next task is to make these updates easier, but I'm afraid it'll have to wait until I'm done with major Android features. I'm also postponing other image dumps as I just want to focus solely on search and related matters. I'm hoping to resume next week.
</p>
<p>
I am going to upload the HTML for English Wikipedia 2016-02 this week. If you want to try the new search, you should start downloading this version. Once I'm done with search, you'll have to download these two files to have the new upgraded search for Android:
</p>
<ul>
<li>
en.wikipedia.org-core.xowa
</li>
<li>
en.wikipedia.org-xtn.search.core.xowa
</li>
</ul>
<p>
Until then, if you're using the Android beta, please bear with the slow search. Thanks.
I'm skipping the release this week. I'm trying to make a lot of performance-related changes to Search that will affect the desktop and Android version. There's a chance I may skip next week also.
</p>
<p>
Also, I'm building English Wiki 2016-02 now. I'm still a little behind in wiki dumps and I'll resume this week.
<spanclass="mw-headline"id="Release_new_image_update_for_English_Wikipedia_.282016-01.29">Release new image update for English Wikipedia (2016-01)</span>
</h3>
<p>
I was a little late this month due to build issues. The direct link is <ahref="https://archive.org/download/Xowa_enwiki_latest/Xowa_enwiki_2016-01-13_file_v2b.7z"rel="nofollow"class="external free">https://archive.org/download/Xowa_enwiki_latest/Xowa_enwiki_2016-01-13_file_v2b.7z</a>
</p>
<h3>
<spanclass="mw-headline"id="Release_new_wikis_for_English_Wikis_.282016-01.29">Release new wikis for English Wikis (2016-01)</span>
</h3>
<p>
I've also updated all English Wikis. I generated Android versions of each as well, and will upload during the week if they proof well. The links are at <ahref="https://archive.org/details/Xowa_enwiki_latest"rel="nofollow"class="external free">https://archive.org/details/Xowa_enwiki_latest</a> and they are listed by domain (EX: <ahref="https://en.wiktionary.org"rel="nofollow"class="external free">https://en.wiktionary.org</a>)
</p>
<h3>
<spanclass="mw-headline"id="Fix_for_search_not_working">Fix for search not working</span>
This was a bug that I introduced back in 3.1.1. Title search doesn't work. For example: <ahref="https://en.wikipedia.org/wiki/Special:Search?search=Earth&fulltext=y">https://en.wikipedia.org/wiki/Special:Search?search=Earth&fulltext=y</a> .
Scroll down to the bottom of the page and click "Run script"
</li>
</ul>
<p>
You can also rebuild the entire wiki.
</p>
<h3>
<spanclass="mw-headline"id="Fix_for_English_Wiktionary_sections_not_expanding_correctly">Fix for English Wiktionary sections not expanding correctly</span>
This bug occurs when opening up any English Wiktionary page. Each page will have Translation tables with a "Hide" / "Show" button. The following occurred when viewing these pages (for example: <ahref="https://en.wiktionary.org/wiki/green">https://en.wiktionary.org/wiki/green</a>)
<spanclass="mw-headline"id="New_Raspberry_Pi_build">New Raspberry Pi build</span>
</h3>
<p>
This build was made possible by yonisolo. Many thanks to him for taking the initiative to get this to work. As a result of his efforts, you can now use your Raspberry Pi to run XOWA as an HTTP server.
</p>
<p>
Note that the GUI does not work due to SWT issues with ARM. I don't know if anyone is interested in having this work, but if so, let me know, and I'll revisit.
</p>
<h3>
<spanclass="mw-headline"id="Android_.28No_release.29">Android (No release)</span>
</h3>
<p>
I'm skipping an Android release this week. I added only one-change (pinch-zoom and bottom panels), and it didn't seem worth a release.
I was planning to improve the Android search version this week, but ended up spending some time on the English Wiki builds as well as underlying database code.
</p>
<p>
I'm still going to work on this database code this week. My aims are the following:
</p>
<ul>
<li>
Add a feature to auto-sync the current English Wikipedia images set (they're around 90 GB)
</li>
<li>
Add some indices to improve performance on the Android search.
The desktop app is a major release. It resolves reference errors in 2016-01 English Wikipedia, fixes wide images on German Wikipedia, and adds a new PageBanner extension
</p>
<p>
The Android app is also a major release. It shows more tables, heiroglyphics, and images with a ? in title.
</p>
<h3>
<spanclass="mw-headline"id="Luaj_fixes_for_references_in_2016-01-13_English_Wikipedia">Luaj fixes for references in 2016-01-13 English Wikipedia</span>
</h3>
<p>
The 2016-01-13 dump had many erros in the reference section due to bugs in Luaj. One of the following would be displayed:
</p>
<ul>
<li>
Check |archiveurl= value (help)
</li>
<li>
Specials character in |{some word}
</li>
</ul>
<p>
These were bugs in Luaj with the frontier pattern and multi-byte chars. They were both resolved in this release.
</p>
<h3>
<spanclass="mw-headline"id="Fix_for_German_Wikipedia_and_extremely_wide_pie_charts">Fix for German Wikipedia and extremely wide pie charts</span>
</h3>
<p>
I'm extremely thankful for this report at <ahref="https://github.com/gnosygnu/xowa/issues/38"rel="nofollow"class="external free">https://github.com/gnosygnu/xowa/issues/38</a> There were HTML issues in German Wikipedia because all the wikis rely implicitly on American formatting rules for decimals. For example:
</p>
<ul>
<li>
The German Wikipedia page for Hausmannstätten specifies a pie chart with a width (Breite) of 0.9 . See: <ahref="https://de.wikipedia.org/wiki/Hausmannst%C3%A4tten?title=Hausmannst%C3%A4tten&action=edit">https://de.wikipedia.org/w/index.php?title=Hausmannst%C3%A4tten&action=edit</a>
</li>
<li>
This value gets multiplied by various numbers in the template. For example: <code>width:{{#expr:18*{{{Breite}}} }}em;</code>. See: <ahref="https://de.wikipedia.org/wiki/Vorlage:Sitzverteilung/?title=Vorlage:Sitzverteilung/&action=edit">https://de.wikipedia.org/w/index.php?title=Vorlage:Sitzverteilung/&action=edit</a>
</li>
</ul>
<p>
XOWA was doing this multiplication using the user's locale.
</p>
<ul>
<li>
For US users (like me), <code>18*.9</code> was calculated correctly as <code>16.2</code>
</li>
<li>
For German users though, <code>18*.9</code> was calculated incorrectly as <code>162</code>.
<ul>
<li>
This was because Java was interpreting the <code>.9</code> using German number-format rules. Since "." is the thousands separator, and "," is the decimal separator, <code>.9</code> became <code>9</code>. For US users, imagine <code>,9</code> becoming <code>9</code>.
</li>
</ul>
</li>
</ul>
<p>
v3.1.5 fixes this issue by asserting that all decimal-parsing is done in the US locale.
</p>
<h3>
<spanclass="mw-headline"id="New_PageBanner_extension_for_Wikivoyage">New PageBanner extension for Wikivoyage</span>
</h3>
<p>
This was an extension introduced by Wikimedia late last year to standardize the display of the image, icons and table of contents at the top of the page. This involved some considerable work on my side (including a Mustache parser), but XOWA now reproduces the same look.
</p>
<h3>
<spanclass="mw-headline"id=".28Android.29_Show_navboxes_and_other_tables">(Android) Show navboxes and other tables</span>
</h3>
<p>
The Wikipedia Mobile app deliberately hides navboxes as well as other tables. I think this is done for the following reasons:
</p>
<ul>
<li>
These tables were meant for desktop display, and often had wide widths
</li>
<li>
These tables clutter the page.
</li>
</ul>
<p>
In contrast, I really do like showing as much content as possible, so I decided to show these tables. I'll probably put an option to disable this later, but I'm going to wait first for some feedback from others
</p>
<h3>
<spanclass="mw-headline"id=".28Android.29_Always_center_table_content">(Android) Always center table content</span>
</h3>
<p>
This is another deviation from the Wikipedia Mobile app style. Basically most tables are left-aligned and would end before reaching the right-hand side of the page. I changed the CSS to have these tables fill up the entire page and center the content.
</p>
<p>
This has one unfortunate sideback in that it breaks the "Collapse" buttons. I'll try to fix this in a future release, but if I can't, I may remove them entirely.
</p>
<h3>
<spanclass="mw-headline"id=".28Android.29_Show_hieroglyphics">(Android) Show hieroglyphics</span>
</h3>
<p>
The early versions of the XOWA Android app did not show hieroglyphics. This is now supported in this build
</p>
<h3>
<spanclass="mw-headline"id=".28Android.29_Show_images_with_.3F_in_file_title">(Android) Show images with ? in file title</span>
</h3>
<p>
This was a bug wherein images that had a ? were not being displayed within the Android WebView. I fixed this by replacing ? with %3F.
I ran into several issues with the 2016-01 English Wikipedia dump that set me back a few days. I'm planning to upload English Wikipedia images and HTML this week, and then continue on with the other English wikis
</p>
<p>
For code, I'm going to tackle performance on the Android search again as well as a few minor UI issues on Android (collapse-table, pinch-zoom)
I accidentally had the wrong dump in place when kicking off the 2016-01-13 build. As such, I didn't spot the issue till this morning after I restarted the build.
Basically, the <ahref="https://dumps.wikimedia.org/enwiki/20160113/"rel="nofollow"class="external text">2016-01-13 English Wikipedia dump</a> introduced new page admininistration functions. These include {{PROTECTIONEXPIRY}} as well as a Scribunto function called getStabilitySettings. This resulted in a bold red "Script error" message at the top of every protected page. There are a lot of protected pages.
</p>
<p>
v3.1.4.2 resolves both issues. So far, it's stable across 35,000+ pages, but if you run across any issues, please report them. Thanks.
The desktop app is a major release. It resolves several wiktionary errors on non-English pages and has better HTML dump generation for other wikis.
</p>
<p>
The Android app is a major release. It has a more responsive search, instant image loading when reloading page, and a fix for pages failing to load if they have spaces and colons in the title.
</p>
<h3>
<spanclass="mw-headline"id="Scribunto_.2F_Luaj_fixes_for_English_Wiktionary">Scribunto / Luaj fixes for English Wiktionary</span>
</h3>
<p>
There were several dozen pages with script errors in English Wiktionary. They basically fell into these categories:
</p>
<ul>
<li>
Luaj / Scribunto errors with MCBS entities in Asian languages (1 glyph; 2 char).
</li>
<li>
Programmatic errors for minor cases
<ul>
<li>
Recursive gsub calls with lua function
</li>
<li>
Search position returned as int not string
</li>
</ul>
</li>
</ul>
<p>
The build log for English Wiktionary looks a lot cleaner now, though I still have to add some support for the {{categorytree}} function.
</p>
<h3>
<spanclass="mw-headline"id="Better_HTML_dump_generation_for_English_Wiktionary.2C_Wikisource.2C_Wikiquote.2C_etc._Also.2C_French_Wikipedia">Better HTML dump generation for English Wiktionary, Wikisource, Wikiquote, etc. Also, French Wikipedia</span>
</h3>
<p>
I ran the HTML dump generator through all the English wikis, as well as French Wikipedia. The results looked good, but there were a lot of log errors that were addressed with this release.
</p>
<h3>
<spanclass="mw-headline"id=".28Android.29_More_responsive_search">(Android) More responsive search</span>
</h3>
<p>
Search is still slow on Android. I'll fix this in a future relase, but I'll have to change the format of the search databases.
</p>
<p>
In the interim, I hacked in the following approach. Assume a search term of "Earth":
</p>
<ul>
<li>
Search for titles that match the term. For example, "Earth". This is fast and usually comes back in 0 - 3 seconds.
</li>
<li>
Search for titles that have the term in any word within the title. For example, "History of Earth". This is moderate and usually comes back in 5 - 10 seconds.
</li>
<li>
Search for titles that have the term starting in any word within the title. For example, "Earthquake". This is slow and usually takes 15 seconds and sometimes more.
</li>
</ul>
<h3>
<spanclass="mw-headline"id=".28Android.29_Instant_image_loading_when_reloading_page">(Android) Instant image loading when reloading page</span>
</h3>
<p>
First, some background. XOWA loads pages in two stages:
</p>
<ul>
<li>
Show the HTML
</li>
<li>
Fill in the images one by one
</li>
</ul>
<p>
The 2nd stage is necessary because it takes a few tenths of a second to retrieve an image from the database. For large pages (20+ images), this would delay page load by a few seconds (for example: 20 images * .2 second = 4 seconds).
</p>
<p>
However, once a page is viewed, reloading a page shouldn't have to re-retrieve the image from the database. The previous releases were actually re-retrieving the image. This release just uses the image if it's already there.
</p>
<h3>
<spanclass="mw-headline"id=".28Android.29_Fix_for_pages_failing_to_load_if_they_have_spaces_and_colons_in_the_title">(Android) Fix for pages failing to load if they have spaces and colons in the title</span>
</h3>
<p>
This only affects a small minority of items that have a colon and spaces in the title. For example, "List of A:B items". XOWA didn't load this page because the underlying Wikipedia Mobile App was encoding the spaces as +.
I haven't uploaded wikis this week, because I'm working on a blocking item in Wikivoyage (Pagebanner). I'm going to delay another week and focus on updating 2016-01-13 English Wikipedia. This means a new HTML dump which should be available by next Sunday. I'm also hoping to upload the other English wikis, and then continue on to French, etc.
</p>
<p>
Meanwhile, I'm going to delay the Google Play Store a few weeks. If anyone thinks I should go to Google Play Store earlier, please let me know. From my side, there are a number of items that still need polish. If you have any feedback, please do post in <ahref="https://github.com/gnosygnu/xowa/issues/36"rel="nofollow"class="external free">https://github.com/gnosygnu/xowa/issues/36</a> I'd appreciate anything: from "Works fine" to "This feature needs some more work".
</p>
<p>
Finally, if you have an Android device and want a wiki for your device, let me know which, and I'll bump it up in priority. The next items in queue are French, German, Chinese and Arabic Wikipedia. I'll get to all the wikis but it may take a few months unless I hear requests otherwise.
<spanclass="mw-headline"id="Documentation_for_html-dump_script._See_Help:Import.2FCommand-line.2FDumps">Documentation for html-dump script. See [[Help:Import/Command-line/Dumps]]
This item is self-explanatory. The XOWA Android app is getting more stable, so I felt it would be time to document the generation of the HTML databases.
</p>
<h3>
<spanclass="mw-headline"id="Improved_Android_beta.2C_including_Random.2C_more_image_display_and_CSS-tweaks._See_https:.2F.2Fgithub.com.2Fgnosygnu.2Fxowa.2Fissues.2F36">Improved Android beta, including Random, more image display and CSS-tweaks. See <ahref="https://github.com/gnosygnu/xowa/issues/36"rel="nofollow"class="external free">https://github.com/gnosygnu/xowa/issues/36</a></span>
</h3>
<p>
This build has a number of new features.
</p>
<ul>
<li>
Random now works in offline mode.
</li>
<li>
All thumb and gallery images should now show up. (approximately 5% of them weren't before)
</li>
<li>
CSS tweaks were added to center the images as well as standardize some background colors
</li>
</ul>
<p>
You can get the latest release here: <ahref="https://github.com/gnosygnu/xowa/releases/"rel="nofollow"class="external free">https://github.com/gnosygnu/xowa/releases/</a>
The Wikimedia dump service resumed, but I'd like to delay French, Polish and Latin for another week. I'm planning to generate HTML dumps for the rest of the English wikis including Wiktionary, Wikisource, Wikivoyage, etc. This will be a good stress test for the new XOWA html-dump format before I continue on to other wikis.
</p>
<p>
I'm also going to continue tweaking the XOWA Android app. If you have a moment to help out with testing, please set it up and give me some feedback: <ahref="https://github.com/gnosygnu/xowa/issues/36"rel="nofollow"class="external free">https://github.com/gnosygnu/xowa/issues/36</a>
If you have Android KitKat or higher and would like to run XOWA on it, I'd be greatly interested in feedback. See the Android progress thread for more details.
I still have some tasks for XOWA Android that I'd like to work on this week. I am going to try to release the main app next week, but if there are no new changes it may slip again in favor of an update of the XOWA Android release
</p>
<p>
I haven't generated any wikis this week as the dump service seems to have come to a halt. Whenever it resumes, I'll pick up again with the promised updates of French, Polish and Greek
I only saw this issue on one page in English Wikipedia (United Kingdom), but it has potential for more effects. Basically, XOWA did not handle <ref> inside a {{#tag}}. For example: {{#tag:ref|<ref>a</ref>}}. For the United Kingdom page, this threw off the format, and made the Infobox as wide as the entire page.
</p>
<h3>
<spanclass="mw-headline"id="Fix_for_incorrect_search_word_counts_and_IPA_links">Fix for incorrect search word counts and IPA links</span>
</h3>
<p>
There was a minor issue with incorrect search counts for words. I don't think this affects anything for desktop searches, but it did throw off the Android search.
</p>
<p>
Meanwhile, due to incorrect URL generation, IPA links would not download from the web after being clicked.
</p>
<h3>
<spanclass="mw-headline"id="Trivial_HTML_changes">Trivial HTML changes</span>
</h3>
<p>
v3.1.1 has a bunch of HTML changes to make it slightly closer to MediaWiki's HTML.
</p>
<ul>
<li>
The most significant one is the removal of the magnify icon, which is now being handled in CSS as opposed to a separate <img> tag.
</li>
<li>
There are a few other ones affecting incorrect escaping of quotes. This would cause incomplete titles when hovering over images or links.
</li>
<li>
Finally there are minor whitespace / attribute generation issues. None of these should be noticeable; they were made to handle log messages during bulk HTML generation
I was on track to release the new Android version tonight, but ran into a last minute issue with thumbs and English Wikipedia. I'm pushing this out another week.
</p>
<p>
For wikis, I'll work on the French Wikipedia refresh, and try to add on Polish and Greek.
</p>
<p>
Finally, an apology to those I've promised minor changes. I've spent a lot of time on Android recently, and there's been a backlog of items. I'm hoping to be done with the Android version in the next few weeks and will work on these items as I get time.
I'm skipping the release again. There were two minor changes, but neither seem to be enough to warrant another version. As always, if anyone notices any serious issues, please do let me know at either <ahref="https://github.com/gnosygnu/xowa/issues"rel="nofollow"class="external free">https://github.com/gnosygnu/xowa/issues</a> or gnosygnu at gmail.com .
</p>
<p>
I did release Russian wikis this week. See: <ahref="https://archive.org/details/Xowa_ruwiki_latest"rel="nofollow"class="external free">https://archive.org/details/Xowa_ruwiki_latest</a>
</p>
<p>
I've spent a lot of time this week on the new Android version. I've actually reached a point this weekend wherein it is working with English Wikipedia.
</p>
<p>
For 3.1.1, I'm going to try to release this new Alpha with for Simple Wikipedia. My aim is to get a release of English Wikipedia shortly afterwards.
</p>
<p>
For wikis, I'll try to do a refresh of French Wikipedia.
I'm skipping the release this week as well. I've spent the week working on the new Android dump format for gallery, as well as a new database merge feature. I haven't found anything worth a release.
</p>
<p>
I posted the English image updates at <ahref="https://archive.org/details/Xowa_enwiki_latest"rel="nofollow"class="external free">https://archive.org/details/Xowa_enwiki_latest</a> I'm working on Russian now, and they'll be ready next week.
</p>
<p>
For 2.12.4, I'm still working on the new Android version for Simple Wikipedia.
I'm skipping the release this week. I've been working on Android-related changes, so there really aren't any significant changes.
</p>
<p>
I posted Arabic wikis at <ahref="https://archive.org/details/Xowa_arwiki_latest"rel="nofollow"class="external free">https://archive.org/details/Xowa_arwiki_latest</a> I ran into an issue with English Wikipedia though, and am rebuilding the dump. It should be ready by the middle of the week.
</p>
<p>
For 2.12.3, I'm continuing work on the Android version for Simple Wikipedia. For wikis, I'll try to do Russian
I'm skipping the release this week. I've been working on Android-related changes, so there really aren't any significant changes.
</p>
<p>
I posted Arabic wikis at <ahref="https://archive.org/details/Xowa_arwiki_latest"rel="nofollow"class="external free">https://archive.org/details/Xowa_arwiki_latest</a> I ran into an issue with English Wikipedia though, and am rebuilding the dump. It should be ready by the middle of the week.
</p>
<p>
For 2.12.3, I'm continuing work on the Android version for Simple Wikipedia. For wikis, I'll try to do Russian
<spanclass="mw-headline"id="Minor_fixes_for_Italian_Wikisource">Minor fixes for Italian Wikisource</span>
</h3>
<p>
These fixes addressed the following:
</p>
<ul>
<li>
Poems with references would show duplicate references at the bottom of the page. In addition, the text of the references may be incorrectly placed in the body of the poem.
</li>
<li>
Image maps with scribunto code relying on the page title generated script errors.
</li>
</ul>
<h3>
<spanclass="mw-headline"id="Minor_parser_fixes_including_mapsource_extension">Minor parser fixes including mapsource extension</span>
</h3>
<p>
These fixes are several, but the following are notable:
</p>
<ul>
<li>
Scribunto code calling json-decode was failing if the code was relying on integer keys. For example, {"1"="a"} needs to parse <code>1</code> as an integer, not a string. Otherwise, code calling <code>ipairs</code> would later fail
</li>
<li>
Mapsource functions such as {{#deg2dd}} would not handle non-ASCII double apostrophes. For example, <code>’’</code> needs to go to <code>''</code> and then to <code>"</code>. XOWA was doing the 1st part (<code>''</code>) but not the second (<code>"</code>)
I spent a good deal of time working on most of these minor fixes, so my progress on Android was limited. However, I did get a text version of Simple Wikipedia working with the new dump and the new UI. I'm planning to work on images this week, and hope to have a new beta for v2.12.2
</p>
<p>
For wikis, I'm generating English now. I'll try to add Arabic this week as well.
This week will be another skipped release. I've only made very minor changes this week, so it didn't seem worth it to make a new release.
</p>
<p>
I did post wikis for Dutch and Latin at <ahref="https://archive.org/details/Xowa_nlwiki_latest"rel="nofollow"class="external free">https://archive.org/details/Xowa_nlwiki_latest</a> and <ahref="https://archive.org/details/Xowa_lawiki_latest"rel="nofollow"class="external free">https://archive.org/details/Xowa_lawiki_latest</a>
</p>
<p>
For 2.12.1 I'm going to finish up the dump and try to get another Android version for Simple Wikipedia. For wikis, I'll work on Italian.
v2.11.4 is a minor release. It has one fix affecting French Wikipedia pages, and another for the simple-mode Category system.
</p>
<h3>
<spanclass="mw-headline"id="Fix_for_.22long-vertical_scrolling.22_on_French_Wikipedia">Fix for "long-vertical scrolling" on French Wikipedia</span>
</h3>
<p>
In v2.11.2, I added a fix to handle extraneous pre sections: see <ahref="#Fix_for_extraneous_pre-sections_in_References"id="xolnki_10"title="">#Fix for extraneous pre-sections in References</a>. It turned out this fix was not correct, and caused pages in French Wikipedia to have large scrolling sections.
</p>
<p>
I reverted the fix for v2.11.4. As it turned out, the issue with extraneous pre sections was handled by the underlying templates themselves.
</p>
<h3>
<spanclass="mw-headline"id="Fix_for_simple-mode_Category_pages_not_loading">Fix for simple-mode Category pages not loading</span>
</h3>
<p>
XOWA generates a simple Category system when it builds a wiki (this is called v1). If you want an authentic version of the Category system (this is called v2), you can always import it separately under [[Import offline]].
</p>
<p>
The simple Category system looks like it broke some time ago during the general database redesign from .sqlite3 to .xowa. I fixed it for this release.
</p>
<h3>
<spanclass="mw-headline"id="Wiki_bundles_for_French.2C_Lithuanian.2C_Limburgish.2C_Estonian.2C_Latvian.2C_Nynorsk.2C_and_Cebuano_wikis">Wiki bundles for French, Lithuanian, Limburgish, Estonian, Latvian, Nynorsk, and Cebuano wikis</span>
</h3>
<p>
There were a lot of wikis this week, but they were mostly small. These have been uploaded to archive.org:
I was able to do a basic HTML dump for simple wiki, but there are still a number of issues. These should be fixed this week, and hopefully I can try the new HTML dump system on English Wikipedia.
</p>
<p>
For wikis, I'm going to work through the last of the old .sqlite3 wikis and go through Dutch (nl.*) and Latin wikis.
v2.11.3 is a fairly minor release. It addresses one minor bug with "1. REDIRECT" showing up on pages.
</p>
<h3>
<spanclass="mw-headline"id="Fix_for_.221._REDIRECT.22_showing_up_on_some_pages">Fix for "1. REDIRECT" showing up on some pages</span>
</h3>
<p>
This was a bug I introduced while fixing another issue in v2.11.2. Some pages would now show "1. REDIRECT", most notably en.w:Earth
</p>
<h3>
<spanclass="mw-headline"id="Wiki_bundles_for_Slovak.2C_Slovenian.2C_Galician.2C_and_Waray-Waray_wikis">Wiki bundles for Slovak, Slovenian, Galician, and Waray-Waray wikis</span>
I fixed the one minor Wikibase issue, but am deferring a few other possible issues till later. I'm still chugging away on the HTML dump. My aim is to get a simple wiki dump for the next release.
</p>
<p>
I generated the English Wiki dump but there were only about 3 thousand new images, and I didn't feel that it merited an update. For wikis, I'm going to update French, and then go through as many as I can of Lithuanian, Limburgish, Estonian, Latvian and Nynorsk.
v2.11.2 is a significant release. It addresses minor, but noticeable issues with gallery sections, location maps, and references. It also has some Wikibase fixes.
<spanclass="mw-headline"id="Fix_for_Gallery_rendering_vertically_instead_of_horizontally">Fix for Gallery rendering vertically instead of horizontally</span>
Wikimedia added a change a few weeks ago to force <gallery> tags to use a css. See <ahref="https://phabricator.wikimedia.org/T110709"rel="nofollow"class="external free">https://phabricator.wikimedia.org/T110709</a> This resulted in galleries being shown vertically, instead of horizontally.
This has been a bug for a few months, but I had misdiagnosed it as bad Module code. Basically, non-English wikis would copy-paste the same Module:Location_map code in to their wikis. This failed to work in XOWA, because:
This basically broke location maps in non-English wikis. I should have caught this earlier, but the first few I looked at were all bad usages (no location coordinates passed).
I think this is also a recent bug, but I can't track down the actual cause. MediaWiki has inconsistent logic for trimming whitespace around template and link arguments. The one at issue was a piece of code like <code>{{TemplateName| B\n }}</code>. On my local version of MediaWiki (1.25.2), it doesn't trim the <code>"\n "</code> after the B and creates a <pre> section. However, on Wikipedia, it does trim the whitespace and does not create a <pre> section.
I think this behavior changed recently, but couldn't find the actual line of code in MediaWiki. For now, XOWA will automatically trim end whitespace for all template arguments. In my opinion this is more intuitive behavior anyway.
Redirects would not work if they had an argument. For example, #REDIRECT [[Target_page|link=collapsed]]
</li>
<li>
Clicking on "Redirected from" links at the top of the page would not work. For example, try <ahref="https://en.wikipedia.org/wiki/UK">https://en.wikipedia.org/wiki/UK</a> and click on "Redirected from UK"
<spanclass="mw-headline"id="Wiki_bundles_for_Danish.2C_Serbo-Croatian.2C_Croatian.2C_and_Estonian_wikis">Wiki bundles for Danish, Serbo-Croatian, Croatian, and Estonian wikis</span>
I made some good progress with the rewritten HTML dump feature this week, but am still not done. I'm hoping to get ready for v2.11.3 but I need to work on a few other minor issues that have spilled over from this week. (namely in Wikibase).
For wikis, I'm generating 2015-11 English Wikipedia. I'm also going to continue through the minor wikis and try to do Slovak, Waray-Waray, Slovanian and Galician
v2.11.1 now supports Hebrew dates for the time function like <code>{{#time:xhxjj xjx xhxjY|28-08-1608 + 341 days}}</code> generating <code>ד' ה'שס\"ט"</code>. In addition there is basic support for Hebrew grammar like <code>{{grammar:prefixed|וabc}}</code> generating <code>ווabc</code>.
<spanclass='mw-headline'id='Image_packages_for_English_Wikipedia.2C_Hebrew.2C_Norwegian_and_Vietnamese_wikis'>Image packages for English Wikipedia, Hebrew, Norwegian and Vietnamese wikis</span>
I've been working on a new UI for the Android alpha. I've also spent time rewriting the HTML dump. For the next few weeks, I don't expect to do anything with the desktop app outside of bug fixing.
I'm skipping the release this week. I spent most of the time this week on the HTML dump as well as Android. I'm looking at doing the regular monthly release next week but don't expect any major issues.
I'm uploading Bulgarian now, but the rest should be ready at archive.org. See: <ahref="https://archive.org/details/Xowa_srwiki_latest"class="external text"rel="nofollow">https://archive.org/details/Xowa_srwiki_latest</a><ahref="https://archive.org/details/Xowa_mswiki_latest"class="external text"rel="nofollow">https://archive.org/details/Xowa_mswiki_latest</a> and <ahref="https://archive.org/details/Xowa_bgwiki_latest"class="external text"rel="nofollow">https://archive.org/details/Xowa_bgwiki_latest</a>
For code, I'm going to change tack again and table the article update function. I'm working on a different XOWA Android UI with hopes of updating the alpha in the next few weeks.
v2.10.2 is a major release. It has a critical fix for the 2015-10 English Wikipedia dump. It also features better functionality for Chinese / Serbian language wikis. Finally, it also has some significant under-the-hood changes
<spanclass='mw-headline'id='Fix_for_broken_references_in_2015-10_English_Wikipedia_dump'>Fix for broken references in 2015-10 English Wikipedia dump</span>
XOWA was showing broken references on 2.6 millions pages for the 2015-10 English Wikipedia dump. This was due to some recent changes in <ahref="https://en.wikipedia.org/wiki/Module:Citation/CS1">Module:Citation/CS1</a>. Specifically, the number of local variables in the citation0 function was greater than the default 200 limit for Luaj.
Serbian languages now have language dropdowns. For example, sr.wikipedia.org now allows you to switch between Cyrillic and Latin variants
</li>
<li>
Chinese and Serbian wikis now fully implement the "-{}-" syntax. This includes some significant functions like recursive conversion, word-interchangeability, and adhoc rule-definition. See: <ahref="https://www.mediawiki.org/wiki/Writing_systems/Syntax">https://www.mediawiki.org/wiki/Writing_systems/Syntax</a>
I'm really hoping that the new functionality matches MediaWiki. If you're a Chinese / Serbian user, please take a moment to spot-check a few pages and let me know if there is anything amiss.
<spanclass='mw-headline'id='Better_support_for_.3Csource.3E_and_.3Csyntaxhighlight.3E'>Better support for <source> and <syntaxhighlight></span>
MediaWiki recently changed the <syntaxhighlight> extension away from geshi to Pygments. In the process, it looks like they changed a few of the general parsing rules as well. v2.10.4 has better support for these blocks, though actual syntax coloring is still some time away.
v2.10.2 now incorporates online calls to Wikimedia APIs. The first use was to download a full list of interwiki aliases for each wiki. For those users in offline mode, you can manually generate the list. For more info, see [[Help:Site config]]
XOWA supports custom creation of wikis by matching articles against words. For example, you can create an English Wikipedia that doesn't have any Pokemon articles. Or you can create an English Wikipedia that just has Pokemon articles. The system is intricate but should be quite powerful. For more info, see [[Help:Import/Dansguardian]]
I'm skipping the release this week. I ran into some issues with Chinese / Serbian translations, though I think I'm pretty close to being done. In addition, I have some other significant changes in queue which I didn't want to introduce for a "first-week-of-the-month" release.
If you want a recent stable release, use <ahref="https://github.com/gnosygnu/xowa/releases/tag/v2.9.4.1"class="external text"rel="nofollow">v2.9.4.1</a>. I'll keep that release up for a month.
<li><ahref="screenshots.html"title='See screenshots of XOWA'>Screenshots</a></li>
<li><ahref="download.html"title='Download the XOWA application'>Download XOWA</a></li>
<li><ahref="image_dbs.html"title='Download offline wikis and image databases'>Download wikis</a></li>
<li><ahref="reviews.html"title='Read what others have written about XOWA'>Media</a></li>
<li><ahref="about.html"title='Get more information about XOWA'>About</a></li>
</ul>
</div>
</div>
<divclass="portal"id='xowa-portal-help'>
<h3>Help</h3>
<divclass="body">
<ul>
<li><ahref="requirements.html"title='Get XOWA's system requirements'>Requirements</a></li>
<li><ahref="installation.html"title='Get instructions for installing XOWA'>Installation</a></li>
<li><ahref="setup_simplewiki.html"title='Learn how to set up Simple Wikipedia'>Set up Simple Wikipedia</a></li>
<li><ahref="setup_enwiki.html"title='Learn how to set up English Wikipedia'>Set up English Wikipedia</a></li>
<li><ahref="setup_other_wikis.html"title='Learn how to set up Other Wikipedias'>Set up Other Wikipedias</a></li>
<li><ahref="contact.html"title='Questions? Comments? Leave feedback for XOWA'>Feedback</a></li>
</ul>
</div>
</div>
<divclass="portal"id='xowa-portal-links'>
<h3>Links</h3>
<divclass="body">
<ul>
<li><ahref="http://dumps.wikimedia.org/backup-index.html"title="Get wiki datababase dumps directly from Wikimedia">Wikimedia dumps</a></li>
<li><ahref="https://archive.org/search.php?query=xowa"title="Search archive.org for XOWA files">XOWA @ archive.org</a></li>
<li><ahref="http://en.wikipedia.org"title="Visit Wikipedia (and compare to XOWA!)">English Wikipedia</a></li>
</ul>
</div>
</div>
<divclass="portal"id='xowa-portal-donate'>
<h3>Donate</h3>
<divclass="body">
<ul>
<li><ahref="https://archive.org/donate/index.php"title="Support archive.org!">archive.org</a></li><!-- listed first due to recent fire damages: http://blog.archive.org/2013/11/06/scanning-center-fire-please-help-rebuild/ -->
