For Diagnostics see Diagnostics#Scribunto
diff --git a/home/wiki/App/Xtn/Page_sync.html b/home/wiki/App/Xtn/Page_sync.html
index ed98ef5cf..99072cc0d 100644
--- a/home/wiki/App/Xtn/Page_sync.html
+++ b/home/wiki/App/Xtn/Page_sync.html
@@ -143,11 +143,16 @@
The Page sync feature is still a work in progress. The following are known issues:
- Math, Helper Buttons (enlarge / more info), Musical scores, and other images don't work
+ Math, Helper Buttons (enlarge / more info), Musical scores, and other images don't work
- Wikipedia stores some images in a separate location. XOWA still needs code to detect this location, copy it offline, and show it correctly. This should be done in the next few releases, but in the meantime it's heavily recommended that you don't use Automatic sync for all pages. In particular, math pages will lose all equations after a sync. For example, https://en.wikipedia.org/wiki/Pythagorean_theorem
+ Wikipedia stores some images in a separate location. XOWA still needs code to detect this location, copy it offline, and show it correctly. This should be done in the next few releases, but in the meantime it's heavily recommended that you don't use Automatic sync for all pages. In particular, math pages will lose all equations after a sync. For example, https://en.wikipedia.org/wiki/Pythagorean_theorem
+
+ -
+ v3.9.4.1 now syncs Math images
+
+
No rollback option
diff --git a/home/wiki/Blog.html b/home/wiki/Blog.html
index 55f784488..b2fd09da4 100644
--- a/home/wiki/Blog.html
+++ b/home/wiki/Blog.html
@@ -64,42 +64,176 @@
+
+
+
+
+ Release: v3.9.4.1 (2016-09-25 20:00 Sun)
+
+
+ The PC version is a major release. It has more Category fixes, more page sync changes, and a few other changes.
+
+
+ The Android version is a minor release. It has a fix for bad file downloads in Download Central.
+
+
+ (Wiki) Release 2016-09 French, English and German Wikipedia
+
+
+ I published the French wikis last week, but I'm just listing them formally in this release.
+
+
+ The English and German wikis were published today. They are available at Special:XowaDownloadCentral
+
+
+ (PC) More minor Category fixes including large categories, dynamic page list and wikidata.org
+
+
+ v3.9.2.1 introduced a new Category system to support Categories in HTML dump mode. Unfortunately, a few items were left out.
+
+
+ -
+ Maximum of 200 pages: Some categories have more than 200 pages but XOWA would only show the first 200.
+
+ -
+ Dynamic Page List did not work: Wikibooks, Wikiversity and Wikinews use an extension called Dynamic Page List which relies heavily on Categories. These pages always came up blank.
+
+ -
+ Wikidata import failed: Importing wikidata.org through Import Online / Offline would fail
+
+
+
+ All of these are fixed in v3.9.4.1. In addition, I also added a feature to disable "Previous 200" on the first page and "Next 200" on the last page.
+
+
+ Finally, these all work with both the Wikitext dumps and the HTML dumps. I still have to get them to work on Android.
+
+
+ (PC) Page sync shows math and video images
+
+
+ v3.9.2.1 added a page sync feature, but it didn't handle Math, video and pdf images. v3.9.4.1 now handles these. There are still a few other image types to handle (helper buttons / score), but sync should now work fine for 99% of pages.
+
+
+ (PC / Android) Download Central does not loop endlessly if wrong file size downloaded
+
+
+ This is a bug that should hopefully not have affected anyone. While testing the downloads for English Wikipedia, I noticed that a "bad file size" error would basically cause Download Central to cycle endlessly. The only option would be to remove the entire task and resume.
+
+
+ (PC) Show pages in MediaWiki namespace
+
+
+ v3.9.4.1 now is able to show wikitext pages in the MediaWiki namespace. For example, https://en.wikipedia.org/wiki/MediaWiki:Edittools .
+
+
+ (PC) Run GUI on Raspberry Pi
+
+
+ As per https://github.com/gnosygnu/xowa/issues/85 the XOWA GUI was not able to run on the Raspberry Pi. I changed SWT to use WebKit in order to get this working. So far, I can only confirm that it works on my device, but hopefully it will work for others.
+
+
+ In addition, this build has the official release candidate sqlite-jdbc jar as per https://github.com/xerial/sqlite-jdbc/issues/58
+
+
+ Many thanks to nstents for helping me test the builds.
+
+
+ (PC) More parser fixes including Scribunto regex at end of string and gaps in argument keys
+
+
+ There were two significant fixes worth mentioning:
+
+
+ -
+ End-of-string regexes did not work: Due to a one-off array bug, XOWA wouldn't correctly process end-of-string regular expressions in Lua. So, something like
gsub( "e?$", "e", 1 )
returned wrong results
+
+ -
+ Gaps in argument keys would fail: Scribunto allows integer keys, but with gaps. For example, something like
{1="a", 4="d", 7="g"}
. XOWA had logic to handle 1 gap, but failed if there were more
+
+
+
+ Next release: v3.10.1
+
+
+ -
+ Wikis: After a busy two weeks, I'm going to take a break this week. If there's a wiki you want, please feel free to request!
+
+ -
+ Dynamic update of wiki pages: I still have a little work to do on this feature.
+
+ -
+ Image shrink: I tested a Download Central version of the image shrink but it felt too slow. I'm going to opt instead for the standalone page. I'll upload the file this week and post again in the blog.
+
+
+
+
+
Release: NONE (2016-09-18 22:00 Sun)
@@ -154,13 +288,13 @@
In short, the changes should be transparent to most, except HTML dump users will soon get Categories.
- There's a little more info at Category Overview for those interested.
+ There's a little more info at Category Overview for those interested.
(PC) Basic page synchronization feature to get latest from online
- As per https://github.com/gnosygnu/xowa/issues/72 XOWA will now be able to sync pages directly from the online version. This feature is still a work-in-progress, and probably should only be done for selective pages. Certain pages won't sync correctly for a few more releases -- namely, pages with Math. See App/Xtn/Page_sync for more info.
+ As per https://github.com/gnosygnu/xowa/issues/72 XOWA will now be able to sync pages directly from the online version. This feature is still a work-in-progress, and probably should only be done for selective pages. Certain pages won't sync correctly for a few more releases -- namely, pages with Math. See App/Xtn/Page_sync for more info.
(PC / Android) Download Central changes for dropped connections / Mac OS X
@@ -172,7 +306,7 @@
(PC) Various parser changes including Protectiong Banner, stack overflow, and invalid UTF-8
- This release has a bunch of parser changes. The Change log has a complete list. The most relevant items are the following:
+ This release has a bunch of parser changes. The Change log has a complete list. The most relevant items are the following:
-
@@ -199,7 +333,7 @@
Torrent links for non-Wikipedia wikis were wrong (thanks to malakov1): Download Central was reporting the wrong torrent links for non-Wikipedia wikis. For example, English Wiktionary was being listed as http://archive.org/Xowa_enwiktionary_latest . This build corrects the issue.
-
- Wrong documentation for HTML dumps (thanks to Rüdiger Gleim): The command-line script for generating HTML dumps have changed over the past few releases. I forgot to update the documentation page at Dev/Command-line/Thumbs.
+ Wrong documentation for HTML dumps (thanks to Rüdiger Gleim): The command-line script for generating HTML dumps have changed over the past few releases. I forgot to update the documentation page at Dev/Command-line/Thumbs.
diff --git a/home/wiki/Blog/2016-04.html b/home/wiki/Blog/2016-04.html
index 8c888e8cc..d7a1cd55e 100644
--- a/home/wiki/Blog/2016-04.html
+++ b/home/wiki/Blog/2016-04.html
@@ -428,7 +428,7 @@
New user: Download the new 2016-03 version. Previously you would have to download 2015-06 set, and then download separate updates for every month between 2015-07 and 2016-03. This was just too cumbersome.
Existing user (2013-11 or something else): Download the 2016-03 version. You have an old set of XOWA image databases that I really can't support any longer (they have an extension of .sqlite3). I know downloading 80 GB is painful, but I'm not planning to change database formats again in the future.
@@ -520,7 +520,7 @@
The total size of English Wikipedia is about 90 GB. 8 GB is from old images: images removed from articles during the day-to-day editing churn.
- If you have English Wikipedia and have been following along with the updates, go to Dashboard/Files/Deletion and follow the instructions therein.
+ If you have English Wikipedia and have been following along with the updates, go to Dashboard/Files/Deletion and follow the instructions therein.
+
+
+
+ Release: v3.9.4.1 (2016-09-25 20:00 Sun)
+
+
+ The PC version is a major release. It has more Category fixes, more page sync changes, and a few other changes.
+
+
+ The Android version is a minor release. It has a fix for bad file downloads in Download Central.
+
+
+ (Wiki) Release 2016-09 French, English and German Wikipedia
+
+
+ I published the French wikis last week, but I'm just listing them formally in this release.
+
+
+ The English and German wikis were published today. They are available at Special:XowaDownloadCentral
+
+
+ (PC) More minor Category fixes including large categories, dynamic page list and wikidata.org
+
+
+ v3.9.2.1 introduced a new Category system to support Categories in HTML dump mode. Unfortunately, a few items were left out.
+
+
+ -
+ Maximum of 200 pages: Some categories have more than 200 pages but XOWA would only show the first 200.
+
+ -
+ Dynamic Page List did not work: Wikibooks, Wikiversity and Wikinews use an extension called Dynamic Page List which relies heavily on Categories. These pages always came up blank.
+
+ -
+ Wikidata import failed: Importing wikidata.org through Import Online / Offline would fail
+
+
+
+ All of these are fixed in v3.9.4.1. In addition, I also added a feature to disable "Previous 200" on the first page and "Next 200" on the last page.
+
+
+ Finally, these all work with both the Wikitext dumps and the HTML dumps. I still have to get them to work on Android.
+
+
+ (PC) Page sync shows math and video images
+
+
+ v3.9.2.1 added a page sync feature, but it didn't handle Math, video and pdf images. v3.9.4.1 now handles these. There are still a few other image types to handle (helper buttons / score), but sync should now work fine for 99% of pages.
+
+
+ (PC / Android) Download Central does not loop endlessly if wrong file size downloaded
+
+
+ This is a bug that should hopefully not have affected anyone. While testing the downloads for English Wikipedia, I noticed that a "bad file size" error would basically cause Download Central to cycle endlessly. The only option would be to remove the entire task and resume.
+
+
+ (PC) Show pages in MediaWiki namespace
+
+
+ v3.9.4.1 now is able to show wikitext pages in the MediaWiki namespace. For example, https://en.wikipedia.org/wiki/MediaWiki:Edittools .
+
+
+ (PC) Run GUI on Raspberry Pi
+
+
+ As per https://github.com/gnosygnu/xowa/issues/85 the XOWA GUI was not able to run on the Raspberry Pi. I changed SWT to use WebKit in order to get this working. So far, I can only confirm that it works on my device, but hopefully it will work for others.
+
+
+ In addition, this build has the official release candidate sqlite-jdbc jar as per https://github.com/xerial/sqlite-jdbc/issues/58
+
+
+ Many thanks to nstents for helping me test the builds.
+
+
+ (PC) More parser fixes including Scribunto regex at end of string and gaps in argument keys
+
+
+ There were two significant fixes worth mentioning:
+
+
+ -
+ End-of-string regexes did not work: Due to a one-off array bug, XOWA wouldn't correctly process end-of-string regular expressions in Lua. So, something like
gsub( "e?$", "e", 1 )
returned wrong results
+
+ -
+ Gaps in argument keys would fail: Scribunto allows integer keys, but with gaps. For example, something like
{1="a", 4="d", 7="g"}
. XOWA had logic to handle 1 gap, but failed if there were more
+
+
+
+ Next release: v3.10.1
+
+
+ -
+ Wikis: After a busy two weeks, I'm going to take a break this week. If there's a wiki you want, please feel free to request!
+
+ -
+ Dynamic update of wiki pages: I still have a little work to do on this feature.
+
+ -
+ Image shrink: I tested a Download Central version of the image shrink but it felt too slow. I'm going to opt instead for the standalone page. I'll upload the file this week and post again in the blog.
+
+
+
+
+
Release: NONE (2016-09-18 22:00 Sun)
@@ -154,13 +288,13 @@
In short, the changes should be transparent to most, except HTML dump users will soon get Categories.
- There's a little more info at Category Overview for those interested.
+ There's a little more info at Category Overview for those interested.
(PC) Basic page synchronization feature to get latest from online
- As per https://github.com/gnosygnu/xowa/issues/72 XOWA will now be able to sync pages directly from the online version. This feature is still a work-in-progress, and probably should only be done for selective pages. Certain pages won't sync correctly for a few more releases -- namely, pages with Math. See App/Xtn/Page_sync for more info.
+ As per https://github.com/gnosygnu/xowa/issues/72 XOWA will now be able to sync pages directly from the online version. This feature is still a work-in-progress, and probably should only be done for selective pages. Certain pages won't sync correctly for a few more releases -- namely, pages with Math. See App/Xtn/Page_sync for more info.
(PC / Android) Download Central changes for dropped connections / Mac OS X
@@ -172,7 +306,7 @@
(PC) Various parser changes including Protectiong Banner, stack overflow, and invalid UTF-8
- This release has a bunch of parser changes. The Change log has a complete list. The most relevant items are the following:
+ This release has a bunch of parser changes. The Change log has a complete list. The most relevant items are the following:
-
@@ -199,7 +333,7 @@
Torrent links for non-Wikipedia wikis were wrong (thanks to malakov1): Download Central was reporting the wrong torrent links for non-Wikipedia wikis. For example, English Wiktionary was being listed as http://archive.org/Xowa_enwiktionary_latest . This build corrects the issue.
-
- Wrong documentation for HTML dumps (thanks to Rüdiger Gleim): The command-line script for generating HTML dumps have changed over the past few releases. I forgot to update the documentation page at Dev/Command-line/Thumbs.
+ Wrong documentation for HTML dumps (thanks to Rüdiger Gleim): The command-line script for generating HTML dumps have changed over the past few releases. I forgot to update the documentation page at Dev/Command-line/Thumbs.
diff --git a/home/wiki/Change_log.html b/home/wiki/Change_log.html
index fbcc30aac..2a17c67b3 100644
--- a/home/wiki/Change_log.html
+++ b/home/wiki/Change_log.html
@@ -36,74 +36,74 @@