Under "Category system", choose "Upgrade to version 2"
diff --git a/home/wiki/App/Databases/Overview.html b/home/wiki/App/Databases/Overview.html
index 859021255..3b1febe44 100644
--- a/home/wiki/App/Databases/Overview.html
+++ b/home/wiki/App/Databases/Overview.html
@@ -93,7 +93,7 @@
Wikitext databases will have -text- in the file name. For example, en.wikipedia.org-text-ns.000.xowa
Wikitext databases have been supported since the very start of XOWA. As such, they have a full set of functionality
diff --git a/home/wiki/App/Import/English_Wikipedia.html b/home/wiki/App/Import/English_Wikipedia.html
index b8a65cab1..4e3ab24d7 100644
--- a/home/wiki/App/Import/English_Wikipedia.html
+++ b/home/wiki/App/Import/English_Wikipedia.html
@@ -138,7 +138,7 @@
Detailed start
diff --git a/home/wiki/App/Import/Import_overview.html b/home/wiki/App/Import/Import_overview.html
index 224c1f246..0d80f6cfb 100644
--- a/home/wiki/App/Import/Import_overview.html
+++ b/home/wiki/App/Import/Import_overview.html
@@ -82,7 +82,7 @@
Import offline by script
- The Import offline page can generate a script that will import a wiki.
+ The Import offline page can generate a script that will import a wiki.
diff --git a/home/wiki/App/Import/Offline.html b/home/wiki/App/Import/Offline.html
index 8cc094cf0..db54f46d9 100644
--- a/home/wiki/App/Import/Offline.html
+++ b/home/wiki/App/Import/Offline.html
@@ -21,11 +21,11 @@
If you've downloaded a dump already, you can import the .bz2 file into XOWA.
diff --git a/home/wiki/App/Search/Score.html b/home/wiki/App/Search/Score.html
index ab2e12836..0b0538968 100644
--- a/home/wiki/App/Search/Score.html
+++ b/home/wiki/App/Search/Score.html
@@ -107,13 +107,17 @@
The following formula is the basis for scaling:
Wait a few seconds. You will get a MikTeX prompt to download another repository. Specifically:
diff --git a/home/wiki/App/Xtn/Mediawiki/Math/Setup.html b/home/wiki/App/Xtn/Mediawiki/Math/Setup.html
index e11ee83ff..54a30d2c5 100644
--- a/home/wiki/App/Xtn/Mediawiki/Math/Setup.html
+++ b/home/wiki/App/Xtn/Mediawiki/Math/Setup.html
@@ -104,7 +104,7 @@
- This week is also a push. There were more changes, especially with Russian Wikipedia, but I can't give a release my full attention until next week.
+ The PC version is a minor release. It fixes an import issue with English Wikipedia on older machines, has several Scribunto and Wikibase fixes for Russian wikis, and has some page sync issues
- The 2016-11 Russian Wikis are up. I'll try to work on the 2016 Italian wikis next.
-
-
- Release: NONE (2016-11-20 22:00 Sun)
-
-
- There is no release this week. I've worked on a few Page sync issues found by khanhhung2512 as well as a new application auto-updater. I may skip next week also due to the holiday season as well as some personal commitments.
-
-
- In the meantime, I uploaded 2016-11 German Wikipedia as well as the Dutch and Afrikaans Wikis. I'll be working on the Russian wikis and French Wikipedia.
-
-
- Release: v3.11.2.1 (2016-11-13 20:00 Sun)
-
-
- The PC version is a minor release. It fixes some Wikibase parsing issues and handles some regression issues, notably bookmarks and variants.
-
-
- The Android version is a minor release. It also adds filtering to Download Central.
+ The Android version has no release.
- (Wiki) Publish 2016-10 French, Polish, Swedish, Spanish wikis. Also, 2016-11 English Wikipedia
+ (Wiki) Publish 2016-11 Dutch and Russian wikis. Also, 2016-11 German Wikipedia
- As it's been a few weeks since the last release, there have been several wiki releases since then.
+ As per the section title, 2016-11 Dutch and Russian wikis are up at archive.org. You can check Wiki_setup/Listing or Special:XowaDownloadCentral
- A special thanks to Ope30 for downloading and testing all these wikis.
+ Again, thanks to Ope30 for testing these wikis.
- (PC) Fix regression errors, including bookmarks, variants, clicking on images, and wrong number of reported pages
+ (PC) Fix "stalled" English Wikipedia import on older machines
- There were a number of regression errors that have crept in over the last few releases. Namely, these are:
+ This issue was reported in issue 98 and and issue 108.
+
+
+ Due to changes in the English Wikipedia Category system, XOWA needed to import a lot more data. Unfortunately, this caused the English Wikipedia import to stall on older machines. I was unable to reproduce it on my current machine (i7 CPU on either SSD or HDD), but was able to reproduce it on my laptop (Core Duo with HDD).
+
+
+ This issue was resolved by adding a new SQL index during the category import. The total time will still be noticeably longer (from 2 hours to 5 hours), but it should complete in the end.
+
+
+ (PC) Fix various minor Scribunto and Wikibase errors with Russian Wikipedia including inferred datatype
+
+
+ There were a number of minor fixes around the 2016-11 Russian wikis.
+
+
+ The most significant one was an issue with Wikidata and missing infobox images. For more detail, you can look at https://lists.wikimedia.org/pipermail/wikidata/2016-November/010019.html . This was fixed for any Russian Wiki imported through Import Online or Import Offline. However, Russian wikis downloaded through Download Central will still be missing images, until the next time I rebuild them.
+
+
+ For the other changes, you can take a look at the Scribunto and Wikibase items at Change log/v3.12.1.1
+
+
+ (PC) Fix page sync issues when syncing File or Chinese pages with math
+
+
+ First, thanks to khanhhung2512 for reporting these issues.
+
- Variant support for Chinese and Serbian languages were not working. For example: -{zh-hans:computer; zh-hant:ELECTRONICBRAIN;}-
+ Failed when downloading Chinese pages with Math
- Clicking on images would not open up a simulation of a Wikimedia Commons page
-
-
- The total number of pages was reported incorrectly
+ Always downloaded every page, instead of those listed in the Options page
- These have been fixed in this release. Thanks to khanhhung2512 and another anonymous user for reporting these issues.
+ These fixes are included in this release.
- (PC) Fix various minor Wikibase errors with geocoordinate, time, and quantity
-
-
- There were some minor Wikibase issues. The most notable of these involved time data which caused script errors on all Polish Wikipedia Software pages. The rest involved many fewer pages (< 100).
-
-
- To get more info on these, see Change log/v3.11.2.1 and the Wikibase entries
-
-
- (PC) Make minor changes to Import/Offline page
-
-
- There were a number of minor issues with the Import/Offline page, primarily due to the Category changes in 2016-09. I made a few changes to eliminate redundant downloads as well as to intelligently detect dump files. However, I'll probably make more in the coming months when time permits.
-
-
- Again, thanks go to khanhhung2512 and another anonymous user for reporting these issues.
-
-
- (Dev) Simplify usage of XOWA as an embeddable parser
-
-
- XOWA now supports usage as an embeddable parser in other apps. More information is at Dev/Parser/Embeddable
-
-
- Thanks here are due to Rüdiger Gleim for suggesting the interface as well as providing valuable feedback
-
-
- Next release: v3.11.3
+ Next release: v3.12.2
- Wikis: I'm generating wikis for the 2016-11 German Wikipedia as well as 2016-11 Dutch Wikis.
+ Wikis: I'm generating wikis for the 2016-11 Italian wikis. I'll also kick off 2016-12 English Wikipedia as well.
- Light schedule: The schedule will continue to be light. I'm currently working on rewriting the Options system. I'll try to add in some exploratory work on full-text search as well as improve Page Sync.
+ Options: I'm almost done rewriting the Options system. I also plan to add an update feature for the desktop app. I'm still planning to do some more work on Page Sync and full-text search, though my time recently has been limited.
- I'm postponing the official release to next week. There are still only a handful of issues, and unfortunately, I don't have the time this week to do a full release.
-
-
- However, I am pushing out a BETA release. This is the same as a regular release, except:
-
-
-
- I haven't documented all the changes in the Change Log or readme.txt (so you'll only know what's included from a short list at https://github.com/gnosygnu/xowa/releases)
-
-
- I haven't tested the release fully (so some of the new items may not work)
-
-
- I won't be able to fix any unexpected regression bugs (so if there is a new critical bug, you should just rollback to the old v3.10.4.1 build)
-
diff --git a/home/wiki/Blog/2015.html b/home/wiki/Blog/2015.html
index 91338ff8a..bff9c63ec 100644
--- a/home/wiki/Blog/2015.html
+++ b/home/wiki/Blog/2015.html
@@ -695,7 +695,7 @@
Fix for simple-mode Category pages not loading
- XOWA generates a simple Category system when it builds a wiki (this is called v1). If you want an authentic version of the Category system (this is called v2), you can always import it separately under Import offline.
+ XOWA generates a simple Category system when it builds a wiki (this is called v1). If you want an authentic version of the Category system (this is called v2), you can always import it separately under Import offline.
The simple Category system looks like it broke some time ago during the general database redesign from .sqlite3 to .xowa. I fixed it for this release.
@@ -961,7 +961,7 @@
- The rest are more trivial in comparison. You can check the Change_log for more detail.
+ The rest are more trivial in comparison. You can check the Change_log for more detail.
Image packages for Serbian, Malay and Bulgarian wikis
@@ -999,7 +999,7 @@
- The rest are more trivial in comparison. You can check the Change_log for more detail.
+ The rest are more trivial in comparison. You can check the Change_log for more detail.
Image packages for Serbian, Malay and Bulgarian wikis
@@ -1465,7 +1465,7 @@
Various minor fixes
- There were a lot of other minor fixes in v2.8.1. Most of these are parser related, but there are a few interesting items under the change section. Please have a look at the Change_log
+ There were a lot of other minor fixes in v2.8.1. Most of these are parser related, but there are a few interesting items under the change section. Please have a look at the Change_log
Next release: v2.8.2
@@ -1540,7 +1540,7 @@
Minor miscellaneous fixes
- There were a bunch of minor fixes. None of these are worth further explanation, so please take a quick look at the Change_log
+ There were a bunch of minor fixes. None of these are worth further explanation, so please take a quick look at the Change_log
- v2.5.4.1 is a significant release. In brief, it involved a rewrite of the online file downloading system to use the same system as the offline version. It also includes instructions for building the image databases on Dashboard/Image_databases as well as an Android alpha. It may be worthwhile to go through the items in Change_log
+ v2.5.4.1 is a significant release. In brief, it involved a rewrite of the online file downloading system to use the same system as the offline version. It also includes instructions for building the image databases on Dashboard/Image_databases as well as an Android alpha. It may be worthwhile to go through the items in Change_log
This item is self-explanatory. The XOWA Android app is getting more stable, so I felt it would be time to document the generation of the HTML databases.
diff --git a/home/wiki/Blog/2016-02.html b/home/wiki/Blog/2016-02.html
index 2beb1f59e..ec01af6c9 100644
--- a/home/wiki/Blog/2016-02.html
+++ b/home/wiki/Blog/2016-02.html
@@ -25,41 +25,44 @@
Find your wiki and click the "Search" button
@@ -203,7 +206,7 @@
- v3.2.1 now expands these tables by default. Note that you can control the default behavior at Options/Wiki_HTML under Collapsible
+ v3.2.1 now expands these tables by default. Note that you can control the default behavior at Options/Wiki_HTML under Collapsible
New Raspberry Pi build
diff --git a/home/wiki/Blog/2016-03.html b/home/wiki/Blog/2016-03.html
index 45297d334..e754aaa65 100644
--- a/home/wiki/Blog/2016-03.html
+++ b/home/wiki/Blog/2016-03.html
@@ -25,41 +25,44 @@
@@ -113,7 +116,7 @@
(Desktop) New autocomplete address bar
- The address bar now supports autocompletion. For example, open up English Wikipedia, and start typing earth. The autocomplete is very fast and supports a lot of advanced functionality. For example you can do a search like earth + (history, future) -middle directly in the address bar. See App/Search as well as Options/Search suggest.
+ The address bar now supports autocompletion. For example, open up English Wikipedia, and start typing earth. The autocomplete is very fast and supports a lot of advanced functionality. For example you can do a search like earth + (history, future) -middle directly in the address bar. See App/Search as well as Options/Search suggest.
Unfortunately, the autocomplete uses the new search system, so old wikis need to upgrade the search databases. You can upgrade by any of the following:
@@ -134,10 +137,10 @@
Find your wiki in the list
@@ -179,7 +182,7 @@
Punctuation friendly: Searches can be done for U.S.A. or USA; dont't or dont; half-life or half or life.
- Boolean searches: Searches can use boolean operators like -, ,, +, (), and *. In addition, there's even an escape operator: \. See App/Search
+ Boolean searches: Searches can use boolean operators like -, ,, +, (), and *. In addition, there's even an escape operator: \. See App/Search
Home wiki: The home wiki is now searchable. Try entering in search or any other word
diff --git a/home/wiki/Blog/2016-04.html b/home/wiki/Blog/2016-04.html
index acd80de4d..7d2cd361a 100644
--- a/home/wiki/Blog/2016-04.html
+++ b/home/wiki/Blog/2016-04.html
@@ -25,41 +25,44 @@
@@ -409,7 +412,7 @@
Really benefits from an SSD: SQLite really does better with an SSD. I tried some tricks like changing PRAGMA synchronous to OFF, but this only shaves off a dozen or so minutes. In contrast, an SSD will easily knock off an hour if not more (from 2 hours to about 40 min)
- If you want the new search, downloading from archive.org is the easiest way: There are other complexities with the search database rebuild (PageRank algorithm and the 10 GB pagelinks dump: See App/Search). As such, the easiest way is to download prebuilt copies from archive.org:
+ If you want the new search, downloading from archive.org is the easiest way: There are other complexities with the search database rebuild (PageRank algorithm and the 10 GB pagelinks dump: See App/Search). As such, the easiest way is to download prebuilt copies from archive.org:
- Existing user (2015-06): Ignore the 2016-03 version. You downloaded the 2015-06 set and presumably have been keeping up with the monthly updates. The 2016-03 set is the same as your set, except it is smaller (it no longer has deleted images). If you want to remove about 8 GB of deleted images, see Dashboard/Files/Deletion. Once you remove the deleted images, you will have a set that is exactly the same as the 2016-03 version.
+ Existing user (2015-06): Ignore the 2016-03 version. You downloaded the 2015-06 set and presumably have been keeping up with the monthly updates. The 2016-03 set is the same as your set, except it is smaller (it no longer has deleted images). If you want to remove about 8 GB of deleted images, see Dashboard/Files/Deletion. Once you remove the deleted images, you will have a set that is exactly the same as the 2016-03 version.
Existing user (2013-11 or something else): Download the 2016-03 version. You have an old set of XOWA image databases that I really can't support any longer (they have an extension of .sqlite3). I know downloading 80 GB is painful, but I'm not planning to change database formats again in the future.
@@ -526,7 +529,7 @@
The total size of English Wikipedia is about 90 GB. 8 GB is from old images: images removed from articles during the day-to-day editing churn.
- If you have English Wikipedia and have been following along with the updates, go to Dashboard/Files/Deletion and follow the instructions therein.
+ If you have English Wikipedia and have been following along with the updates, go to Dashboard/Files/Deletion and follow the instructions therein.
(Package) Release of French Wikipedia 2016-03
diff --git a/home/wiki/Blog/2016-05.html b/home/wiki/Blog/2016-05.html
index f14c84e7f..317e7ad8b 100644
--- a/home/wiki/Blog/2016-05.html
+++ b/home/wiki/Blog/2016-05.html
@@ -25,41 +25,44 @@
@@ -189,7 +192,7 @@
(Wiki) 2016-06 English Wiktionary, Wikisource, Wikivoyage, Wikiquote, Wikibooks, Wikiversity, Wikinews and Species Wiki
- All English wikis are now available for Android as well as desktop (HTML dumps). To download them, go to Download Central.
+ All English wikis are now available for Android as well as desktop (HTML dumps). To download them, go to Download Central.
(All) Fixes / changes for Download Central including multiple-tasks bug
@@ -311,7 +314,7 @@
v3.6.3.3 fixes this issue. It now uses the wikitext dumps if the HTML dumps are not there. Just update your app, and you will see actual pages, not blank ones.
- Also, note that you can disable the automatic HTML read by going to Options/HTML_databases
+ Also, note that you can disable the automatic HTML read by going to Options/HTML_databases
(PC) Fix Download Central icons for Mac OS X
@@ -359,7 +362,7 @@
(PC & Android) New Download Central to download HTML dumps and images
- Download Central is the major feature of the release. This is an in-app downloader that can download wikis for both Android or desktop. It can download images as well.
+ Download Central is the major feature of the release. This is an in-app downloader that can download wikis for both Android or desktop. It can download images as well.
For v3.6.3, there are only two wikis: Simple Wikipedia and English Wikipedia. More wikis will be added every week throughout 2016. Next week, v3.6.4 should have other English wikis, like English Wiktionary and Wikisource.
@@ -368,7 +371,7 @@
Going forward, Download Central will be the primary vehicle to get XOWA wikis. It provides a simple way to import wikis. It eliminates any confusion about which files to download and where to copy them. Monthly updates for English Wikipedia will be published here as well.
(PC & Server) Android HTML dumps are now usable
@@ -429,7 +432,7 @@
- Requires separate post-processing generation step: The wikitext dumps were automatically generated by downloading an XML dump. The HTML dumps requires another post-processing step that is not simple to run (See: Dev/Command-line/Dumps)
+ Requires separate post-processing generation step: The wikitext dumps were automatically generated by downloading an XML dump. The HTML dumps requires another post-processing step that is not simple to run (See: Dev/Command-line/Dumps)
@@ -524,10 +527,10 @@
(Wikis) English Wikipedia (2016-06) and Simple Wikipedia (2016-06)
@@ -178,7 +181,7 @@
(Wiki) Publish 2016-07 English Wikipedia
- The 2016-07 versions of English Wikipedia is up. You can get them through Download Central.
+ The 2016-07 versions of English Wikipedia is up. You can get them through Download Central.
For images, if you want the latest:
@@ -268,7 +271,7 @@
(Wiki) Publish 2016-07 French Wikipedia, Wiktionary, Wikisource, Wikivoyage, Wikiquote, Wikibooks, Wikiversity, and Wikinews
- The 2016-07 versions of the French Wikis are up. You can get them through Download Central.
+ The 2016-07 versions of the French Wikis are up. You can get them through Download Central.
(PC) Fix Redirects not working for HTML databases
@@ -377,7 +380,7 @@
For those who are unaware, Mattze96 was the amazing developer who contributed the original HTTP Server code. This time, Mattze96 contributed mwad: the MediaWiki API dump tool. This tool allows creating XML dumps for Wikia and other wikis (https://wiki.archlinux.org/).
(PC) Support Gallery
@@ -479,7 +482,7 @@
There were a number of fixes for crashes in uncommon scenarios. Most of these involved switching SD cards, or deleting wikis outside XOWA. The crash was bad enough such that XOWA would not work unless the Storage files were cleared (or XOWA was reinstalled).
- These are fixed in this version. For more info, see the Change log
+ These are fixed in this version. For more info, see the Change log
Next release: v3.7.2
diff --git a/home/wiki/Blog/2016-08.html b/home/wiki/Blog/2016-08.html
index 92169e306..b41cfd33c 100644
--- a/home/wiki/Blog/2016-08.html
+++ b/home/wiki/Blog/2016-08.html
@@ -25,41 +25,44 @@
@@ -161,7 +164,7 @@
(Wiki) Publish 2016-08 English Wikipedia and German Wikipedia
- The 2016-08 versions of both wikis are finally up. You can get them through Download Central.
+ The 2016-08 versions of both wikis are finally up. You can get them through Download Central.
(PC / Android) Better html database support for packed galleries, video thumbnails, and image maps
@@ -210,7 +213,7 @@
(PC) Add torrent link / MD5 info to the Download Central Info page
- Based on some welcome feedback from malakov1, I added a torrent link to the Download Central Info page. For example, Special:XowaDownloadCentralInfo?task id=96. Note that these torrent links are to the full archive.org folder, not the task. In particular, the following two types will be included:
+ Based on some welcome feedback from malakov1, I added a torrent link to the Download Central Info page. For example, Special:XowaDownloadCentralInfo?task id=96. Note that these torrent links are to the full archive.org folder, not the task. In particular, the following two types will be included:
- The 2016-07 versions of the Polish wikis are up. You can get them through Download Central.
+ The 2016-07 versions of the Polish wikis are up. You can get them through Download Central.
(PC) Fix random "SSL peer shut down incorrectly" when downloading database dumps
@@ -410,7 +413,7 @@ http://ftp.fi.muni.cz/pub/wikimedia/
(Wiki) Publish 2016-07 Arabic Wiktionary, Wikisource, Wikiquote, Wikibooks, Wikiversity, and Wikinews
- The 2016-07 versions of the Arabic wikis are up. You can get them through Download Central.
+ The 2016-07 versions of the Arabic wikis are up. You can get them through Download Central.
(PC) Fix "invalid title" when clicking on wikis in left-hand nav
diff --git a/home/wiki/Blog/2016-09.html b/home/wiki/Blog/2016-09.html
index 9cc029dec..32cdb603a 100644
--- a/home/wiki/Blog/2016-09.html
+++ b/home/wiki/Blog/2016-09.html
@@ -25,41 +25,44 @@
@@ -328,13 +331,13 @@
In short, the changes should be transparent to most, except HTML dump users will soon get Categories.
- There's a little more info at Category Overview for those interested.
+ There's a little more info at Category Overview for those interested.
(PC) Basic page synchronization feature to get latest from online
- As per https://github.com/gnosygnu/xowa/issues/72 XOWA will now be able to sync pages directly from the online version. This feature is still a work-in-progress, and probably should only be done for selective pages. Certain pages won't sync correctly for a few more releases -- namely, pages with Math. See App/Xtn/Page_sync for more info.
+ As per https://github.com/gnosygnu/xowa/issues/72 XOWA will now be able to sync pages directly from the online version. This feature is still a work-in-progress, and probably should only be done for selective pages. Certain pages won't sync correctly for a few more releases -- namely, pages with Math. See App/Xtn/Page_sync for more info.
(PC / Android) Download Central changes for dropped connections / Mac OS X
@@ -346,7 +349,7 @@
(PC) Various parser changes including Protectiong Banner, stack overflow, and invalid UTF-8
- This release has a bunch of parser changes. The Change log has a complete list. The most relevant items are the following:
+ This release has a bunch of parser changes. The Change log has a complete list. The most relevant items are the following:
@@ -373,7 +376,7 @@
Torrent links for non-Wikipedia wikis were wrong (thanks to malakov1): Download Central was reporting the wrong torrent links for non-Wikipedia wikis. For example, English Wiktionary was being listed as http://archive.org/Xowa_enwiktionary_latest . This build corrects the issue.
- Wrong documentation for HTML dumps (thanks to Rüdiger Gleim): The command-line script for generating HTML dumps have changed over the past few releases. I forgot to update the documentation page at Dev/Command-line/Thumbs.
+ Wrong documentation for HTML dumps (thanks to Rüdiger Gleim): The command-line script for generating HTML dumps have changed over the past few releases. I forgot to update the documentation page at Dev/Command-line/Thumbs.
@@ -185,7 +188,7 @@
(PC) Fix import errors in Import/Offline
- Dashboard/Import/Offline was broken due to the recent changes in the Category system. In addition, there were a few other minor fixes.
+ Dashboard/Import/Offline was broken due to the recent changes in the Category system. In addition, there were a few other minor fixes.
@@ -256,7 +259,7 @@
HTML dumps now show wikitext HTML: Category pages sometimes have a letter index at the top of the page, or other information. For example, https://de.wikipedia.org/wiki/Category:Mann has a large table of contents listing many 2-letter combinations. This information didn't appear in the HTML dumps before. Now they do
- Other minor changes: There are a small number of other changes as well which are covered more in the Change log
+ Other minor changes: There are a small number of other changes as well which are covered more in the Change log
@@ -275,7 +278,7 @@
Basically, v3.10.4.2 allows changing XOWA pages through custom Javascript. This is intended for non-Wikimedia wikis (such as Wikia) which use custom extension that are not supported in XOWA. A user can add this missing custom extension by writing an extension in Javascript.
Next release: v3.10.2
@@ -301,7 +304,7 @@
I did create a deletion database for English Wikipedia. It will reduce the size of the images datases from 101 GB to 90 GB.
Variant support for Chinese and Serbian languages were not working. For example: -{zh-hans:computer; zh-hant:ELECTRONICBRAIN;}-
@@ -172,7 +175,7 @@
There were some minor Wikibase issues. The most notable of these involved time data which caused script errors on all Polish Wikipedia Software pages. The rest involved many fewer pages (< 100).
(PC) Make minor changes to Import/Offline page
@@ -187,7 +190,7 @@
(Dev) Simplify usage of XOWA as an embeddable parser
- XOWA now supports usage as an embeddable parser in other apps. More information is at Dev/Parser/Embeddable
+ XOWA now supports usage as an embeddable parser in other apps. More information is at Dev/Parser/Embeddable
Thanks here are due to Rüdiger Gleim for suggesting the interface as well as providing valuable feedback
diff --git a/home/wiki/Blog/2016-12.html b/home/wiki/Blog/2016-12.html
new file mode 100644
index 000000000..8319ccfb9
--- /dev/null
+++ b/home/wiki/Blog/2016-12.html
@@ -0,0 +1,275 @@
+
+
+
+
+ Blog/2016-12 - XOWA
+
+
+
+
+
+
+
+
+
Blog/2016-12
+
+
From XOWA: the free, open-source, offline wiki application
+ The PC version is a minor release. It fixes an import issue with English Wikipedia on older machines, has several Scribunto and Wikibase fixes for Russian wikis, and has some page sync issues
+
+
+ The Android version has no release.
+
+
+ (Wiki) Publish 2016-11 Dutch and Russian wikis. Also, 2016-11 German Wikipedia
+
+ Due to changes in the English Wikipedia Category system, XOWA needed to import a lot more data. Unfortunately, this caused the English Wikipedia import to stall on older machines. I was unable to reproduce it on my current machine (i7 CPU on either SSD or HDD), but was able to reproduce it on my laptop (Core Duo with HDD).
+
+
+ This issue was resolved by adding a new SQL index during the category import. The total time will still be noticeably longer (from 2 hours to 5 hours), but it should complete in the end.
+
+
+ (PC) Fix various minor Scribunto and Wikibase errors with Russian Wikipedia including inferred datatype
+
+
+ There were a number of minor fixes around the 2016-11 Russian wikis.
+
+
+ The most significant one was an issue with Wikidata and missing infobox images. For more detail, you can look at https://lists.wikimedia.org/pipermail/wikidata/2016-November/010019.html . This was fixed for any Russian Wiki imported through Import Online or Import Offline. However, Russian wikis downloaded through Download Central will still be missing images, until the next time I rebuild them.
+
+
+ For the other changes, you can take a look at the Scribunto and Wikibase items at Change log/v3.12.1.1
+
+
+ (PC) Fix page sync issues when syncing File or Chinese pages with math
+
+
+ First, thanks to khanhhung2512 for reporting these issues.
+
+
+ XOWA had the following page sync issues:
+
+
+
+ Failed when downloading "File:" pages
+
+
+ Failed when downloading Chinese pages with Math
+
+
+ Always downloaded every page, instead of those listed in the Options page
+
+
+
+ These fixes are included in this release.
+
+
+ Next release: v3.12.2
+
+
+
+ Wikis: I'm generating wikis for the 2016-11 Italian wikis. I'll also kick off 2016-12 English Wikipedia as well.
+
+
+ Options: I'm almost done rewriting the Options system. I also plan to add an update feature for the desktop app. I'm still planning to do some more work on Page Sync and full-text search, though my time recently has been limited.
+
+
+
\ No newline at end of file
diff --git a/home/wiki/Change_log.html b/home/wiki/Change_log.html
index 1ad15efbf..0f36a18fb 100644
--- a/home/wiki/Change_log.html
+++ b/home/wiki/Change_log.html
@@ -36,7 +36,7 @@
@@ -235,11 +246,321 @@
The most important category to review is major. The other categories may be skipped due to lower importance (if they were more important, they would be bumped up to major).
- Message: Erreur : le thème « littérature française » du modèle Template:Ébauche n’est pas défini.
+ Message: Erreur : le thème « littérature française » du modèle Template:Ébauche n’est pas défini.
Resolved by: Fix regex pattern for matching end of string.
- (add) Import: Import/Script redesigned to be more intuitive {contributed by Schnark}. See: Dashboard/Import/Offline
+ (add) Import: Import/Script redesigned to be more intuitive {contributed by Schnark}. See: Dashboard/Import/Offline
@@ -1822,7 +1822,7 @@
(add) Timeline: Tabs in text data supported; EX:http://de.wikipedia.org/wiki/Hilfe:Zeitleisten#TextData {contributed by Schnark}.
- (add) Import: allow GUI selection of data dump file {requested by hidp123;Karimoune}. See: Dashboard/Import/Offline
+ (add) Import: allow GUI selection of data dump file {requested by hidp123;Karimoune}. See: Dashboard/Import/Offline
(add) Import: if offline and importing new wiki, automatically copy home wiki's /html/ directory.
@@ -1860,7 +1860,7 @@
(add) Search syntax supports AND, OR, quotes; EX:http://en.wikipedia.org/wiki/Special:Search/Earth_AND_History?fulltext=y&search=Earth+AND+History {requested by Schnark}. See App/Search
(add) Wiki import can read directly from bz2; no need to unzip to xml {requested by Schark, Miles}. See Dev/Design/Data_dump_format
diff --git a/home/wiki/Change_log/2014.html b/home/wiki/Change_log/2014.html
index 29347aa00..6f064846a 100644
--- a/home/wiki/Change_log/2014.html
+++ b/home/wiki/Change_log/2014.html
@@ -2945,7 +2945,7 @@
Parser.Toc: Parse link inside xml node (affects page not loading); EX:== <i>[[A]]</i> ==. See: https://pl.wiktionary.org/wiki/head_sth_off
- Gui: Change message box prompt from "yes" to "ok" {detected by Anselm}. See: Dashboard/Import/Offline
+ Gui: Change message box prompt from "yes" to "ok" {detected by Anselm}. See: Dashboard/Import/Offline
@@ -3915,7 +3915,7 @@
- Import.Script: Change "Uncompress" default from "uncompress" to "read from compressed file" {detected by Anselm}. See: Dashboard/Import/Offline
+ Import.Script: Change "Uncompress" default from "uncompress" to "read from compressed file" {detected by Anselm}. See: Dashboard/Import/Offline
Options: Fix file selector button not working for "Import bz2 by stdout process" {detected by Anselm}. See: Options/Import
@@ -4220,7 +4220,7 @@
Messages: Add "Contatti" message for contactpage in itwiki sidebar. See: https://it.wikipedia.org
@@ -4321,7 +4321,7 @@
- Import: Set search to v2 (not v1) when importing with category v2 {detected by Miles; Anselm; Schnark}. See: Dashboard/Import/Offline
+ Import: Set search to v2 (not v1) when importing with category v2 {detected by Miles; Anselm; Schnark}. See: Dashboard/Import/Offline
Gui.Url_bar: Fix shortcuts for wd.p and wd.q; EX:wd.q:2 -> www.wikidata.org/wiki/Q2. [broken since:v1.1.4.1]
diff --git a/home/wiki/Change_log/2015.html b/home/wiki/Change_log/2015.html
index c9dd878ad..d5f6457c9 100644
--- a/home/wiki/Change_log/2015.html
+++ b/home/wiki/Change_log/2015.html
@@ -2513,7 +2513,7 @@
+
+
\ No newline at end of file
diff --git a/home/wiki/Change_log/v3.6.3.1.html b/home/wiki/Change_log/v3.6.3.1.html
index 0e4c989f9..0753dd98a 100644
--- a/home/wiki/Change_log/v3.6.3.1.html
+++ b/home/wiki/Change_log/v3.6.3.1.html
@@ -400,7 +400,7 @@
Internet access needed: You will need internet access to use this page. If you don't have internet access but you've already downloaded a dump file, see App/Import/Offline
@@ -80,16 +80,16 @@
Commons
- Wikibase: Fix script error "Division by zero" error on 90 en.w pages.
+ Import.offline: Do not re-download category dump files when importing wiki (redux). {detected by khanhhung2512 }
+
+
+
+
+ Xtn.Math: Do not try to translate math in variant wikis. {detected by anonymous}
- Message: =Module:Decimals:10 Unable to convert "<strong class="error">Division by zero.</strong>" to a number
+ Resolved by: Swap out math tags with UNIQ.
- Resolved by: Parse numbers with fractions correctly; do not convert to zero.
+ Example: <math>x-{1+2}-1</math> -> x-{1+2}-1 x> x1+21.
- Wikibase: Fix script error "Formatting error: invalid input when rounding%" error on 90 en.w pages.
+ Table_of_contents: Fix missing table of contents on some de.w television series pages. {detected by Ope30}
- Message: Formatting error: invalid input when rounding%
+ Resolved by: Ignore TOC magic word on transcluded pages.
- Resolved by: Do not output quantity.unit if it is not a wikidata url.
-
- Wikibase: Fix wrong Inception for Earth as well as wrong dates for Julian Calendar entries.
+ ParserFunctions: Fix missing headers from several dozen ru.s Slavik pages.
- Resolved by: Do not automatically convert dates to julian.
+ Resolved by: Implement {{ROOTPAGENAME}}.
- Luaj: Fix "Module:Xlat:86" on a few dozen pl.w pages.
+ Scribunto: Fix script error "Module:Navbox:91 attempt to concatenate nil and string" on many ru.w pages.
- Message: =Module:xlat:86 bad argument: number expected, got nil
+ Message: =Module:Navbox:91 attempt to concatenate nil and string
- Resolved by: Handle nil arguments for table.unpack.
+ Resolved by: Use local language's namespace name not canonical.
- Example: table.unpack(nil, nil).
+ Example: Russian "Шаблон" not English "Template".
- ParserFunctions: Fix wrong number of total pages shown on Main_Page. {detected by anonymous}
+ Scribunto: Fix script error 'expandTemplate: template "Россия Москва" does not exist' on many ru.w pages.
- Resolved by: Change {{NUMBEROFPAGES}} to read from site_stats.ss_total_pages and {{NUMBEROFARTICLES}} to read from site_stats.ss_good_articles.
+ Message: expandTemplate: template "Россия Москва" does not exist
- Lang.Variants: Fix variants not working in Chinese and other wikis. {detected by anonymous}
+ Wikibase: Fix missing infobox images on many ru.w pages.
- Resolved by: Add initialization assertion to variant rule parser.
+ Resolved by: Infer datatype from cached table not from JSON doc.
- Html_dump: Fix images not showing when going back / forward on wikinews. {detected by Ope30}
+ Wikibase: Fix script error "Module:WD:455" on a dozen ru.s pages.
- Resolved by: Always reload page when going back / forward on wikinews (do not use cached html).
+ Message: Ошибка скрипта: =Module:WD:455 свойство P1343 не найдено
- Links: https://en.wikinews.org/wiki
+ Resolved by: Return 'property' not 'item' if wikidata page is "Property:".
+
- Page_history: Add option to log all page visits to a separate file. {requested by anonymous}
+ Gui.Url_bar: Show title in actual chars, not url-decoded chars.
- Links: Options/Dev
+ Resolved by: Set page url to actual chars, not url-decoded chars.
+
+
+ Page_sync: Do not fail with null ref exception when trying to auto-sync a non-existant file. {detected by khanhhung2512 }
+
- v3.11.2.1 features the following
+ v3.12.1.1 features the following
- (Wiki) Publish 2016-10 French, Polish, Swedish, Spanish wikis. Also, 2016-11 English Wikipedia
+ (Wiki) Publish 2016-11 Dutch and Russian wikis. Also, 2016-11 German Wikipedia
- (PC) Fix regression errors, including bookmarks, variants, clicking on images, and wrong number of reported pages
+ (PC) Fix "stalled" English Wikipedia import on older machines
- (PC) Fix various minor Wikibase errors with geocoordinate, time, and quantity
+ (PC) Fix various minor Scribunto and Wikibase errors with Russian Wikipedia including inferred datatype.
- (PC) Make minor changes to Import/Offline page
-
-
- (Dev) Simplify usage of XOWA as an embeddable parser
+ (PC) Fix page sync issues when syncing File or Chinese pages with math
- For more details about this release, please see the blog and the change log.
+ For more details about this release, please see the blog and the change log.
For more details about the release schedule, please see the release schedule.
@@ -197,7 +194,7 @@
Navigate to your wiki page from the list
@@ -235,7 +232,7 @@
Upgrade users
- If you are upgrading from any version before v3.10.1, you should download a xowa_app_v3.10.1+ file.
+ If you are upgrading from any version before v3.12.1, you should download a xowa_app_v3.12.1+ file.
Select the dump and import it
diff --git a/home/wiki/Wiki_setup/Arabic_wikis.html b/home/wiki/Wiki_setup/Arabic_wikis.html
index 80b84f40f..48c736922 100644
--- a/home/wiki/Wiki_setup/Arabic_wikis.html
+++ b/home/wiki/Wiki_setup/Arabic_wikis.html
@@ -379,7 +379,7 @@
Download your dump from https://dumps.wikimedia.org/backup-index.html
Select the dump and import it
diff --git a/home/wiki/Wiki_setup/Czech_wikis.html b/home/wiki/Wiki_setup/Czech_wikis.html
index c2b84c7b9..1b4d1e5b5 100644
--- a/home/wiki/Wiki_setup/Czech_wikis.html
+++ b/home/wiki/Wiki_setup/Czech_wikis.html
@@ -379,7 +379,7 @@
Download your dump from https://dumps.wikimedia.org/backup-index.html
Select the dump and import it
diff --git a/home/wiki/Wiki_setup/Dutch_wikis.html b/home/wiki/Wiki_setup/Dutch_wikis.html
new file mode 100644
index 000000000..80b67a75d
--- /dev/null
+++ b/home/wiki/Wiki_setup/Dutch_wikis.html
@@ -0,0 +1,1269 @@
+
+
+
+
+ Wiki setup/Dutch wikis - XOWA
+
+
+
+
+
+
+
+
+
Wiki setup/Dutch wikis
+
+
From XOWA: the free, open-source, offline wiki application
+
+
+
+
+ Overview
+
+
+ This page describes how to set up Dutch wikis on your machine. The following two options are available:
+
+
+ Download pre-built wikis from archive.org
+
+
+
+ Faster: The build process is skipped completely. All you have to do is download the wikis
+
+
+ Simpler: The wikis are pre-compiled HTML, so you don't have to set-up Wikidata or other pre-requisites. Since the wiki is just being downloaded, not built, there are less things that can go wrong
+
+
+ Less recent: The wikis need to be manually generated and uploaded by me. If you find that the wikis below are out of date, you can create an issue at github.org or try building them yourself.
+
+
+
+ Build wikis using the database dumps at wikimedia.org
+
+
+
+ Slower: It takes an extra few hours to build the wiki
+
+
+ Slightly harder: These wikis work best with Wikidata on your machine. See App/Wiki types/Wikidata. In additon, the build process may not work on certain low-end machines like Raspberry Pi
+
+ In the Available table, add any of the following task names
+
+
+
+
+
+
+ Nederlands Wikipedia - Articles (2016-11) [6.15 GB]
+
+
+
+
+
+
+
+
+ Nederlands Wikipedia - Images (2016-11) [22.27 GB]
+
+
+
+
+
+
+
+
+ Nederlands Wiktionary - Articles (2016-11) [627.8 MB]
+
+
+
+
+
+
+
+
+ Nederlands Wiktionary - Images (2016-11) [94.68 MB]
+
+
+
+
+
+
+
+
+ Nederlands Wikisource - Articles (2016-11) [46.58 MB]
+
+
+
+
+
+
+
+
+ Nederlands Wikisource - Images (2016-11) [94.94 MB]
+
+
+
+
+
+
+
+
+ Nederlands Wikivoyage - Articles (2016-11) [13.10 MB]
+
+
+
+
+
+
+
+
+ Nederlands Wikivoyage - Images (2016-11) [358.6 MB]
+
+
+
+
+
+
+
+
+ Nederlands Wikiquote - Articles (2016-11) [4.86 MB]
+
+
+
+
+
+
+
+
+ Nederlands Wikiquote - Images (2016-11) [15.74 MB]
+
+
+
+
+
+
+
+
+ Nederlands Wikibooks - Articles (2016-11) [35.17 MB]
+
+
+
+
+
+
+
+
+ Nederlands Wikibooks - Images (2016-11) [305.85 MB]
+
+
+
+
+
+
+
+
+ Nederlands Wikinews - Articles (2016-11) [4.12 MB]
+
+
+
+
+
+
+
+
+ Nederlands Wikinews - Images (2016-11) [6.3 MB]
+
+
+
+
+
+
+ In the Queue table, click the Play button
+
+
+ Wait for the Queue to process. When it is done, enter the wiki URL in the bar. For example, nl.wikipedia.org
+
+
+
+ Manual
+
+
+
+ Download the urls below. Note that they are listed in two formats:
+
+
+ Urls by wiki / type: In case you want only one wiki (wiktionary) or one type (articles)
+
+
+ All urls (for copying into a download manager)
+
+
+
+
+ Unzip them and move the .xowa file to the proper wiki directory. For example, for nl.wikipedia.org, move the files to C:\xowa\wiki\nl.wikipedia.org
+
+
+ Start XOWA and enter the wiki URL in the bar. For example, nl.wikipedia.org
+
+
+
+ Build wikis using the database dumps at wikimedia.org
+
+
+
\ No newline at end of file
diff --git a/home/wiki/Wiki_setup/English_wikis.html b/home/wiki/Wiki_setup/English_wikis.html
index 0539c41b8..831142967 100644
--- a/home/wiki/Wiki_setup/English_wikis.html
+++ b/home/wiki/Wiki_setup/English_wikis.html
@@ -564,7 +564,7 @@
Download your dump from https://dumps.wikimedia.org/backup-index.html
Select the dump and import it
diff --git a/home/wiki/Wiki_setup/French_wikis.html b/home/wiki/Wiki_setup/French_wikis.html
index 2acb79dfc..b84aba785 100644
--- a/home/wiki/Wiki_setup/French_wikis.html
+++ b/home/wiki/Wiki_setup/French_wikis.html
@@ -420,7 +420,7 @@
Download your dump from https://dumps.wikimedia.org/backup-index.html
Select the dump and import it
diff --git a/home/wiki/Wiki_setup/German_wikis.html b/home/wiki/Wiki_setup/German_wikis.html
index 408db1158..bed6dda34 100644
--- a/home/wiki/Wiki_setup/German_wikis.html
+++ b/home/wiki/Wiki_setup/German_wikis.html
@@ -492,7 +492,7 @@
Download your dump from https://dumps.wikimedia.org/backup-index.html
Select the dump and import it
diff --git a/home/wiki/Wiki_setup/Haitian_wikis.html b/home/wiki/Wiki_setup/Haitian_wikis.html
index 090c48369..a9aa6bc29 100644
--- a/home/wiki/Wiki_setup/Haitian_wikis.html
+++ b/home/wiki/Wiki_setup/Haitian_wikis.html
@@ -205,7 +205,7 @@
Download your dump from https://dumps.wikimedia.org/backup-index.html
Select the dump and import it
diff --git a/home/wiki/Wiki_setup/Listing.html b/home/wiki/Wiki_setup/Listing.html
index 91aedc7c8..d112a82dd 100644
--- a/home/wiki/Wiki_setup/Listing.html
+++ b/home/wiki/Wiki_setup/Listing.html
@@ -34,22 +34,28 @@
Wiki setup/French wikis
Select the dump and import it
diff --git a/home/wiki/Wiki_setup/Russian_wikis.html b/home/wiki/Wiki_setup/Russian_wikis.html
new file mode 100644
index 000000000..8556e76dc
--- /dev/null
+++ b/home/wiki/Wiki_setup/Russian_wikis.html
@@ -0,0 +1,1515 @@
+
+
+
+
+ Wiki setup/Russian wikis - XOWA
+
+
+
+
+
+
+
+
+
Wiki setup/Russian wikis
+
+
From XOWA: the free, open-source, offline wiki application
+
+
+
+
+ Overview
+
+
+ This page describes how to set up Russian wikis on your machine. The following two options are available:
+
+
+ Download pre-built wikis from archive.org
+
+
+
+ Faster: The build process is skipped completely. All you have to do is download the wikis
+
+
+ Simpler: The wikis are pre-compiled HTML, so you don't have to set-up Wikidata or other pre-requisites. Since the wiki is just being downloaded, not built, there are less things that can go wrong
+
+
+ Less recent: The wikis need to be manually generated and uploaded by me. If you find that the wikis below are out of date, you can create an issue at github.org or try building them yourself.
+
+
+
+ Build wikis using the database dumps at wikimedia.org
+
+
+
+ Slower: It takes an extra few hours to build the wiki
+
+
+ Slightly harder: These wikis work best with Wikidata on your machine. See App/Wiki types/Wikidata. In additon, the build process may not work on certain low-end machines like Raspberry Pi
+
+ In the Available table, add any of the following task names
+
+
+
+
+
+
+ Русский Wikipedia - Articles (2016-11) [12.16 GB]
+
+
+
+
+
+
+
+
+ Русский Wikipedia - Images (2016-11) [25.73 GB]
+
+
+
+
+
+
+
+
+ Русский Wiktionary - Articles (2016-11) [3.44 GB]
+
+
+
+
+
+
+
+
+ Русский Wiktionary - Images (2016-11) [295.44 MB]
+
+
+
+
+
+
+
+
+ Русский Wikisource - Articles (2016-11) [2.30 GB]
+
+
+
+
+
+
+
+
+ Русский Wikisource - Images (2016-11) [849.90 MB]
+
+
+
+
+
+
+
+
+ Русский Wikivoyage - Articles (2016-11) [57.17 MB]
+
+
+
+
+
+
+
+
+ Русский Wikivoyage - Images (2016-11) [2.8 GB]
+
+
+
+
+
+
+
+
+ Русский Wikiquote - Articles (2016-11) [76.14 MB]
+
+
+
+
+
+
+
+
+ Русский Wikiquote - Images (2016-11) [61.24 MB]
+
+
+
+
+
+
+
+
+ Русский Wikibooks - Articles (2016-11) [23.55 MB]
+
+
+
+
+
+
+
+
+ Русский Wikibooks - Images (2016-11) [96.28 MB]
+
+
+
+
+
+
+
+
+ Русский Wikiversity - Articles (2016-11) [23.60 MB]
+
+
+
+
+
+
+
+
+ Русский Wikiversity - Images (2016-11) [64.73 MB]
+
+
+
+
+
+
+
+
+ Русский Wikinews - Articles (2016-11) [243.69 MB]
+
+
+
+
+
+
+
+
+ Русский Wikinews - Images (2016-11) [682.57 MB]
+
+
+
+
+
+
+ In the Queue table, click the Play button
+
+
+ Wait for the Queue to process. When it is done, enter the wiki URL in the bar. For example, ru.wikipedia.org
+
+
+
+ Manual
+
+
+
+ Download the urls below. Note that they are listed in two formats:
+
+
+ Urls by wiki / type: In case you want only one wiki (wiktionary) or one type (articles)
+
+
+ All urls (for copying into a download manager)
+
+
+
+
+ Unzip them and move the .xowa file to the proper wiki directory. For example, for ru.wikipedia.org, move the files to C:\xowa\wiki\ru.wikipedia.org
+
+
+ Start XOWA and enter the wiki URL in the bar. For example, ru.wikipedia.org
+
+
+
+ Build wikis using the database dumps at wikimedia.org
+
+
+
\ No newline at end of file
diff --git a/home/wiki/Wiki_setup/Simple_wikis.html b/home/wiki/Wiki_setup/Simple_wikis.html
index a24560053..1ef4e141d 100644
--- a/home/wiki/Wiki_setup/Simple_wikis.html
+++ b/home/wiki/Wiki_setup/Simple_wikis.html
@@ -205,7 +205,7 @@
Download your dump from https://dumps.wikimedia.org/backup-index.html
Select the dump and import it
diff --git a/home/wiki/Wiki_setup/Spanish_wikis.html b/home/wiki/Wiki_setup/Spanish_wikis.html
index f5c5022d4..a549abce2 100644
--- a/home/wiki/Wiki_setup/Spanish_wikis.html
+++ b/home/wiki/Wiki_setup/Spanish_wikis.html
@@ -408,7 +408,7 @@
Download your dump from https://dumps.wikimedia.org/backup-index.html
Select the dump and import it
diff --git a/home/wiki/Wiki_setup/Swedish_wikis.html b/home/wiki/Wiki_setup/Swedish_wikis.html
index 3551321d2..99c7864b8 100644
--- a/home/wiki/Wiki_setup/Swedish_wikis.html
+++ b/home/wiki/Wiki_setup/Swedish_wikis.html
@@ -408,7 +408,7 @@
Download your dump from https://dumps.wikimedia.org/backup-index.html
