For Diagnostics see Diagnostics#Scribunto
diff --git a/home/wiki/App/Xtn/Page_sync.html b/home/wiki/App/Xtn/Page_sync.html
index ed98ef5cf..99072cc0d 100644
--- a/home/wiki/App/Xtn/Page_sync.html
+++ b/home/wiki/App/Xtn/Page_sync.html
@@ -143,11 +143,16 @@
The Page sync feature is still a work in progress. The following are known issues:
- Math, Helper Buttons (enlarge / more info), Musical scores, and other images don't work
+ Math, Helper Buttons (enlarge / more info), Musical scores, and other images don't work
- Wikipedia stores some images in a separate location. XOWA still needs code to detect this location, copy it offline, and show it correctly. This should be done in the next few releases, but in the meantime it's heavily recommended that you don't use Automatic sync for all pages. In particular, math pages will lose all equations after a sync. For example, https://en.wikipedia.org/wiki/Pythagorean_theorem
+ Wikipedia stores some images in a separate location. XOWA still needs code to detect this location, copy it offline, and show it correctly. This should be done in the next few releases, but in the meantime it's heavily recommended that you don't use Automatic sync for all pages. In particular, math pages will lose all equations after a sync. For example, https://en.wikipedia.org/wiki/Pythagorean_theorem
+ (PC) More minor Category fixes including large categories, dynamic page list and wikidata.org
+
+
+ v3.9.2.1 introduced a new Category system to support Categories in HTML dump mode. Unfortunately, a few items were left out.
+
+
+
+ Maximum of 200 pages: Some categories have more than 200 pages but XOWA would only show the first 200.
+
+
+ Dynamic Page List did not work: Wikibooks, Wikiversity and Wikinews use an extension called Dynamic Page List which relies heavily on Categories. These pages always came up blank.
+
+
+ Wikidata import failed: Importing wikidata.org through Import Online / Offline would fail
+
+
+
+ All of these are fixed in v3.9.4.1. In addition, I also added a feature to disable "Previous 200" on the first page and "Next 200" on the last page.
+
+
+ Finally, these all work with both the Wikitext dumps and the HTML dumps. I still have to get them to work on Android.
+
+
+ (PC) Page sync shows math and video images
+
+
+ v3.9.2.1 added a page sync feature, but it didn't handle Math, video and pdf images. v3.9.4.1 now handles these. There are still a few other image types to handle (helper buttons / score), but sync should now work fine for 99% of pages.
+
+
+ (PC / Android) Download Central does not loop endlessly if wrong file size downloaded
+
+
+ This is a bug that should hopefully not have affected anyone. While testing the downloads for English Wikipedia, I noticed that a "bad file size" error would basically cause Download Central to cycle endlessly. The only option would be to remove the entire task and resume.
+
+ As per https://github.com/gnosygnu/xowa/issues/85 the XOWA GUI was not able to run on the Raspberry Pi. I changed SWT to use WebKit in order to get this working. So far, I can only confirm that it works on my device, but hopefully it will work for others.
+
+ Many thanks to nstents for helping me test the builds.
+
+
+ (PC) More parser fixes including Scribunto regex at end of string and gaps in argument keys
+
+
+ There were two significant fixes worth mentioning:
+
+
+
+ End-of-string regexes did not work: Due to a one-off array bug, XOWA wouldn't correctly process end-of-string regular expressions in Lua. So, something like gsub( "e?$", "e", 1 ) returned wrong results
+
+
+ Gaps in argument keys would fail: Scribunto allows integer keys, but with gaps. For example, something like {1="a", 4="d", 7="g"}. XOWA had logic to handle 1 gap, but failed if there were more
+
+
+
+ Next release: v3.10.1
+
+
+
+ Wikis: After a busy two weeks, I'm going to take a break this week. If there's a wiki you want, please feel free to request!
+
+
+ Dynamic update of wiki pages: I still have a little work to do on this feature.
+
+
+ Image shrink: I tested a Download Central version of the image shrink but it felt too slow. I'm going to opt instead for the standalone page. I'll upload the file this week and post again in the blog.
+
+
+
+
+
Release: NONE (2016-09-18 22:00 Sun)
@@ -154,13 +288,13 @@
In short, the changes should be transparent to most, except HTML dump users will soon get Categories.
- There's a little more info at Category Overview for those interested.
+ There's a little more info at Category Overview for those interested.
(PC) Basic page synchronization feature to get latest from online
- As per https://github.com/gnosygnu/xowa/issues/72 XOWA will now be able to sync pages directly from the online version. This feature is still a work-in-progress, and probably should only be done for selective pages. Certain pages won't sync correctly for a few more releases -- namely, pages with Math. See App/Xtn/Page_sync for more info.
+ As per https://github.com/gnosygnu/xowa/issues/72 XOWA will now be able to sync pages directly from the online version. This feature is still a work-in-progress, and probably should only be done for selective pages. Certain pages won't sync correctly for a few more releases -- namely, pages with Math. See App/Xtn/Page_sync for more info.
(PC / Android) Download Central changes for dropped connections / Mac OS X
@@ -172,7 +306,7 @@
(PC) Various parser changes including Protectiong Banner, stack overflow, and invalid UTF-8
- This release has a bunch of parser changes. The Change log has a complete list. The most relevant items are the following:
+ This release has a bunch of parser changes. The Change log has a complete list. The most relevant items are the following:
@@ -199,7 +333,7 @@
Torrent links for non-Wikipedia wikis were wrong (thanks to malakov1): Download Central was reporting the wrong torrent links for non-Wikipedia wikis. For example, English Wiktionary was being listed as http://archive.org/Xowa_enwiktionary_latest . This build corrects the issue.
- Wrong documentation for HTML dumps (thanks to Rüdiger Gleim): The command-line script for generating HTML dumps have changed over the past few releases. I forgot to update the documentation page at Dev/Command-line/Thumbs.
+ Wrong documentation for HTML dumps (thanks to Rüdiger Gleim): The command-line script for generating HTML dumps have changed over the past few releases. I forgot to update the documentation page at Dev/Command-line/Thumbs.
diff --git a/home/wiki/Blog/2016-04.html b/home/wiki/Blog/2016-04.html
index 8c888e8cc..d7a1cd55e 100644
--- a/home/wiki/Blog/2016-04.html
+++ b/home/wiki/Blog/2016-04.html
@@ -428,7 +428,7 @@
New user: Download the new 2016-03 version. Previously you would have to download 2015-06 set, and then download separate updates for every month between 2015-07 and 2016-03. This was just too cumbersome.
- Existing user (2015-06): Ignore the 2016-03 version. You downloaded the 2015-06 set and presumably have been keeping up with the monthly updates. The 2016-03 set is the same as your set, except it is smaller (it no longer has deleted images). If you want to remove about 8 GB of deleted images, see Dashboard/Files/Deletion. Once you remove the deleted images, you will have a set that is exactly the same as the 2016-03 version.
+ Existing user (2015-06): Ignore the 2016-03 version. You downloaded the 2015-06 set and presumably have been keeping up with the monthly updates. The 2016-03 set is the same as your set, except it is smaller (it no longer has deleted images). If you want to remove about 8 GB of deleted images, see Dashboard/Files/Deletion. Once you remove the deleted images, you will have a set that is exactly the same as the 2016-03 version.
Existing user (2013-11 or something else): Download the 2016-03 version. You have an old set of XOWA image databases that I really can't support any longer (they have an extension of .sqlite3). I know downloading 80 GB is painful, but I'm not planning to change database formats again in the future.
@@ -520,7 +520,7 @@
The total size of English Wikipedia is about 90 GB. 8 GB is from old images: images removed from articles during the day-to-day editing churn.
- If you have English Wikipedia and have been following along with the updates, go to Dashboard/Files/Deletion and follow the instructions therein.
+ If you have English Wikipedia and have been following along with the updates, go to Dashboard/Files/Deletion and follow the instructions therein.
(Package) Release of French Wikipedia 2016-03
diff --git a/home/wiki/Blog/2016-09.html b/home/wiki/Blog/2016-09.html
index cf9e15de6..414707153 100644
--- a/home/wiki/Blog/2016-09.html
+++ b/home/wiki/Blog/2016-09.html
@@ -64,42 +64,176 @@
+ (PC) More minor Category fixes including large categories, dynamic page list and wikidata.org
+
+
+ v3.9.2.1 introduced a new Category system to support Categories in HTML dump mode. Unfortunately, a few items were left out.
+
+
+
+ Maximum of 200 pages: Some categories have more than 200 pages but XOWA would only show the first 200.
+
+
+ Dynamic Page List did not work: Wikibooks, Wikiversity and Wikinews use an extension called Dynamic Page List which relies heavily on Categories. These pages always came up blank.
+
+
+ Wikidata import failed: Importing wikidata.org through Import Online / Offline would fail
+
+
+
+ All of these are fixed in v3.9.4.1. In addition, I also added a feature to disable "Previous 200" on the first page and "Next 200" on the last page.
+
+
+ Finally, these all work with both the Wikitext dumps and the HTML dumps. I still have to get them to work on Android.
+
+
+ (PC) Page sync shows math and video images
+
+
+ v3.9.2.1 added a page sync feature, but it didn't handle Math, video and pdf images. v3.9.4.1 now handles these. There are still a few other image types to handle (helper buttons / score), but sync should now work fine for 99% of pages.
+
+
+ (PC / Android) Download Central does not loop endlessly if wrong file size downloaded
+
+
+ This is a bug that should hopefully not have affected anyone. While testing the downloads for English Wikipedia, I noticed that a "bad file size" error would basically cause Download Central to cycle endlessly. The only option would be to remove the entire task and resume.
+
+ As per https://github.com/gnosygnu/xowa/issues/85 the XOWA GUI was not able to run on the Raspberry Pi. I changed SWT to use WebKit in order to get this working. So far, I can only confirm that it works on my device, but hopefully it will work for others.
+
+ Many thanks to nstents for helping me test the builds.
+
+
+ (PC) More parser fixes including Scribunto regex at end of string and gaps in argument keys
+
+
+ There were two significant fixes worth mentioning:
+
+
+
+ End-of-string regexes did not work: Due to a one-off array bug, XOWA wouldn't correctly process end-of-string regular expressions in Lua. So, something like gsub( "e?$", "e", 1 ) returned wrong results
+
+
+ Gaps in argument keys would fail: Scribunto allows integer keys, but with gaps. For example, something like {1="a", 4="d", 7="g"}. XOWA had logic to handle 1 gap, but failed if there were more
+
+
+
+ Next release: v3.10.1
+
+
+
+ Wikis: After a busy two weeks, I'm going to take a break this week. If there's a wiki you want, please feel free to request!
+
+
+ Dynamic update of wiki pages: I still have a little work to do on this feature.
+
+
+ Image shrink: I tested a Download Central version of the image shrink but it felt too slow. I'm going to opt instead for the standalone page. I'll upload the file this week and post again in the blog.
+
+
+
+
+
Release: NONE (2016-09-18 22:00 Sun)
@@ -154,13 +288,13 @@
In short, the changes should be transparent to most, except HTML dump users will soon get Categories.
- There's a little more info at Category Overview for those interested.
+ There's a little more info at Category Overview for those interested.
(PC) Basic page synchronization feature to get latest from online
- As per https://github.com/gnosygnu/xowa/issues/72 XOWA will now be able to sync pages directly from the online version. This feature is still a work-in-progress, and probably should only be done for selective pages. Certain pages won't sync correctly for a few more releases -- namely, pages with Math. See App/Xtn/Page_sync for more info.
+ As per https://github.com/gnosygnu/xowa/issues/72 XOWA will now be able to sync pages directly from the online version. This feature is still a work-in-progress, and probably should only be done for selective pages. Certain pages won't sync correctly for a few more releases -- namely, pages with Math. See App/Xtn/Page_sync for more info.
(PC / Android) Download Central changes for dropped connections / Mac OS X
@@ -172,7 +306,7 @@
(PC) Various parser changes including Protectiong Banner, stack overflow, and invalid UTF-8
- This release has a bunch of parser changes. The Change log has a complete list. The most relevant items are the following:
+ This release has a bunch of parser changes. The Change log has a complete list. The most relevant items are the following:
@@ -199,7 +333,7 @@
Torrent links for non-Wikipedia wikis were wrong (thanks to malakov1): Download Central was reporting the wrong torrent links for non-Wikipedia wikis. For example, English Wiktionary was being listed as http://archive.org/Xowa_enwiktionary_latest . This build corrects the issue.
- Wrong documentation for HTML dumps (thanks to Rüdiger Gleim): The command-line script for generating HTML dumps have changed over the past few releases. I forgot to update the documentation page at Dev/Command-line/Thumbs.
+ Wrong documentation for HTML dumps (thanks to Rüdiger Gleim): The command-line script for generating HTML dumps have changed over the past few releases. I forgot to update the documentation page at Dev/Command-line/Thumbs.
The most important category to review is major. The other categories may be skipped due to lower importance (if they were more important, they would be bumped up to major).
+
+ v3.9.4.1 (2016-09-25)
+
+
+ Wiki
+
+
+
+ Wiki: Publish 2016-09 French Wikipedia HTML and images.
+
- Scribunto: Fix categorytree script error on many en.d pages. Message: Script error: @C:/xowa/bin/any/xowa/xtns/Scribunto/engines/Luaj/MWServer.lua:59 vm error: gplx.Err: callParserFunction: function was not found: function=#categorytree
-
-
-
-
- Resolved by: Implement basic functionality for {{#categorytree}}.
-
- Scribunto: Fix 'parameter "2" is required' script error on several dozen English Wikipedia category pages. Message: Script error: =Module:parameters:175 The parameter "2" is required.
-
-
-
-
- Resolved by: Add entries for null value arguments. Example: [2:'b'] -> [1:null,2:'b'].
-
- Scribunto: Fix class cast error on a few dozen en.d pages. Message: Script error: @C:/xowa/bin/any/xowa/xtns/Scribunto/engines/Luaj/MWServer.lua:59 vm error: java.lang.ClassCastException: org.luaj.vm2.LuaNil cannot be cast to org.luaj.vm2.LuaTable
-
-
-
-
- Resolved by: Handle UCS chars at end of array.
-
- Scribunto: Fix ClassCast script error on 1 de.v page. Message: Skriptfehler: @C:/xowa/bin/any/xowa/xtns/Scribunto/engines/Luaj/MWServer.lua:59 vm error: gplx.Err: val is not in switch/if: val=java.lang.Double – Breite:
-
-
-
-
- Resolved by: Handle double for replace arg in ustring.gsub.
-
(add) Translation: Added translations for Simplified Chinese and Traditional Chinese {contributed by zjzengdongyang}. See: Options/Language
@@ -1099,7 +1099,7 @@
- (add) Gui: Application menu bar now available. See: Options/Menus
+ (add) Gui: Application menu bar now available. See: Options/Menus
(add) Addon: Addon can automatically redirect http: to xowa: when offline {contributed by treck}.
@@ -2152,7 +2152,7 @@
(add) Wikidata Json structured data formatter {contributed by Schnark} http://www.wikidata.org/wiki/Q2
@@ -2327,7 +2327,7 @@
- (add) Preliminary support for Scribunto/Lua. See Options/Scribunto
+ (add) Preliminary support for Scribunto/Lua. See Options/Scribunto
(add) Improvements to Schnark's Javascript Timeline {contributed by Schnark}
diff --git a/home/wiki/Change_log/2014.html b/home/wiki/Change_log/2014.html
index 90688bb7c..8779710d7 100644
--- a/home/wiki/Change_log/2014.html
+++ b/home/wiki/Change_log/2014.html
@@ -2986,7 +2986,7 @@
Gui.Url_bar: Do not lose history page position after editing page; EX:Open page -> Scroll down -> Click link -> Edit -> Click back -> Position should be restored {detected by Schnark}.
- Gui: Fix StackOverflow exception when auto_focus_id is " first_anchor" and exiting app on Help:Options page. See: Options/Scribunto
+ Gui: Fix StackOverflow exception when auto_focus_id is " first_anchor" and exiting app on Help:Options page. See: Options/Scribunto
Html: Remove exit link from upper left hand corner.
@@ -3754,7 +3754,7 @@
- Scribunto: Add luaj as alternate lua engine. See: Options/Scribunto
+ Scribunto: Add luaj as alternate lua engine. See: Options/Scribunto
+ Scribunto: Fix categorytree script error on many en.d pages. Message: Script error: @C:/xowa/bin/any/xowa/xtns/Scribunto/engines/Luaj/MWServer.lua:59 vm error: gplx.Err: callParserFunction: function was not found: function=#categorytree
+
+
+
+
+ Resolved by: Implement basic functionality for {{#categorytree}}.
+
+ Scribunto: Fix 'parameter "2" is required' script error on several dozen English Wikipedia category pages. Message: Script error: =Module:parameters:175 The parameter "2" is required.
+
+
+
+
+ Resolved by: Add entries for null value arguments. Example: [2:'b'] -> [1:null,2:'b'].
+
+ Scribunto: Fix class cast error on a few dozen en.d pages. Message: Script error: @C:/xowa/bin/any/xowa/xtns/Scribunto/engines/Luaj/MWServer.lua:59 vm error: java.lang.ClassCastException: org.luaj.vm2.LuaNil cannot be cast to org.luaj.vm2.LuaTable
+
+
+
+
+ Resolved by: Handle UCS chars at end of array.
+
+ Scribunto: Fix ClassCast script error on 1 de.v page. Message: Skriptfehler: @C:/xowa/bin/any/xowa/xtns/Scribunto/engines/Luaj/MWServer.lua:59 vm error: gplx.Err: val is not in switch/if: val=java.lang.Double – Breite:
+
+
+
+
+ Resolved by: Handle double for replace arg in ustring.gsub.
+
- Windows / Linux / Mac OS X
+ Windows / Linux / Mac OS X
major
@@ -733,7 +2407,7 @@
Core: Parse decimals using US locale, not user locale. Resolves extremely wide pie charts on many de.w pages. {detected by markusmaresch} See: https://de.wikipedia.org/wiki/Hausmannstätten
- Luaj: Use HOUR_OF_DAY for os.time, not HOUR (resolves hour off by 12 for os.time calls). See: Diagnostics/Scribunto/Luaj
+ Luaj: Use HOUR_OF_DAY for os.time, not HOUR (resolves hour off by 12 for os.time calls). See: Diagnostics/Scribunto/Luaj
major
@@ -901,14 +2575,14 @@
v3.1.3.1 (2016-01-17)
- Windows / Linux / Mac OS X
+ Windows / Linux / Mac OS X
add
- Command-line: Expand instructions for generating HTML dumps. See: Dev/Command-line/Dumps
+ Command-line: Expand instructions for generating HTML dumps. See: Dev/Command-line/Dumps
@@ -942,7 +2616,7 @@
- Android
+ Android
fix
diff --git a/home/wiki/Change_log/v3.7.4.1.html b/home/wiki/Change_log/v3.7.4.1.html
index 832f8acd5..c8f42e9ac 100644
--- a/home/wiki/Change_log/v3.7.4.1.html
+++ b/home/wiki/Change_log/v3.7.4.1.html
@@ -88,7 +88,7 @@
Resolved by: Invalidate all Scribunto engines across all wikis when disabled.
+
+
\ No newline at end of file
diff --git a/home/wiki/Dashboard/Wiki_maintenance.html b/home/wiki/Dashboard/Wiki_maintenance.html
index 9b1edcdee..14cb2abdb 100644
--- a/home/wiki/Dashboard/Wiki_maintenance.html
+++ b/home/wiki/Dashboard/Wiki_maintenance.html
@@ -123,7 +123,7 @@
n
- Html_dump: Show categories for 2016-09 dumps. {requested by Ope30}
+ Category: Fix dynamic page list not working for DynamicPageList. [broken since: 3.9.2.1]
- Html_dump: Add left-hand sidebar for 2016-09 dumps. {detected by Ope30}
+ Category: Fix category not working for www.wikidata.org. [broken since: 3.9.2.1] {detected by Rüdiger Gleim; Ope30}
- Resolved by: Dump MediaWiki namespace (8).
-
-
-
-
- Page_sync: Add basic option to synchronize pages. {requested by Mde186}
-
- DownloadCentral: Fix Download Central "hanging" on Mac OS X. {detected by markusmaresch}
+ Category: Disable Previous / Next 200 if at start / end of category range.
- DownloadCentral: Fix torrent links for non-Wikipedia wikis. {detected by malakov1}
+ DownloadCentral: Do not retry endlessly if wrong size downloaded.
+
+
+
+
+ Scribunto: Fix NullPointerReference script error in geobox coord on 4 en.w pages.
- Database: Fix slow performance when SQLite files are read-only. {detected by Ope30}
+ Luaj: Fix script error at head of page for many fr.w pages.
- Resolved by: Open database connection in "read-only" mode if marked readonly.
+ Message: Erreur : le thème « littérature française » du modèle Template:Ébauche n’est pas défini.
- Example: properties.setProperty("open_mode", "1").
+ Resolved by: Fix regex pattern for matching end of string.
+
- Scribunto: Do not show "Wikipedia pages with incorrect protection templates" for protected-pages.
+ Parser: Fix several dozen MediaWiki pages failing to load.
- Resolved by: Change titleLib.GetProtectionLevels to return semi-protected instead of null.
+ Resolved by: Handle standalone dollar signs and backslashes.
- v3.9.2.1 features the following:
+ v3.9.4.1 features the following:
- (PC) Fix for Category pages not working
+ (Wiki) Release 2016-09 French, English and German Wikipedia
- (PC) New Category system to handle HTML dumps
+ (PC) More minor Category fixes including large categories, dynamic page list and wikidata.org
- (PC) Basic page synchronization feature to get latest from online wiki
+ (PC) Page sync shows math and video images
- (PC / Android) Download Central changes for dropped connections / Mac OS X
+ (PC / Android) Download Central does not loop endlessly if wrong file size downloaded
- (PC) Various parser changes including Protectiong Banner, stack overflow, and invalid UTF-8
+ (PC) Show pages in MediaWiki namespace
- (PC) Other minor changes including read-only support, torrent-file links and docs for HTML dump.
+ (PC) Run GUI on Raspberry Pi
+
+
+ (PC) More parser fixes including Scribunto regex at end of string and gaps in argument keys
diff --git a/home/wiki/Options.html b/home/wiki/Options.html
index 0189239f9..984d55020 100644
--- a/home/wiki/Options.html
+++ b/home/wiki/Options.html
@@ -492,7 +492,7 @@ li.active a, li.active a:hover