diff --git a/home/wiki/Blog.html b/home/wiki/Blog.html index 6c58072b6..8aeeebe4c 100644 --- a/home/wiki/Blog.html +++ b/home/wiki/Blog.html @@ -58,84 +58,185 @@ +

+ Release: v3.7.4.1 (2016-07-25 19:00 Mon) +

+

+ The PC version is a minor release. It fixes a build issue when building wikis from old dumps by command-line script. +

+

+ The Android version is a major release. It has a new screen to change the wiki location for Download Central +

+

+ (Wiki) Publish 2016-07 English Wikipedia +

+

+ The 2016-07 versions of English Wikipedia is up. You can get them through Download Central. +

+

+ For images, if you want the latest: +

+ +

+ For articles, if you want the latest: +

+ +

+ (Android) Add screen to change wiki location for Download Central +

+

+ First, some background. XOWA Android tries to use the external SD card for downloading wikis. Unfortunately, this is not easy, as different devices may have different paths for the external SD card (it varies by Android version as well as by manufacturer). If XOWA doesn't guess correctly, then the wikis will be downloaded to internal memory +

+

+ In v3.7.1, I added some logic to try to correctly detect the external SD card for one device (BLU on Android Lollipop). In the process, I ended up making the detection worse for other devices. +

+

+ v3.7.4 attempts to fix this by reverting back to the previous detection strategy. In addition, I also included a new "folder selection" screen to manually choose the external SD card. +

+

+ You can access this folder selection screen by clicking the "folder" icon in Download Central. Note that you will need to restart the app after you change the folder. +

+

+ Note that you can always manually download the wiki from archive.org and import them using the "XOWA file browser". The "XOWA file browser" is available through the "folder" icon on the "XOWA" Wikis page. +

+

+ (PC) Fix automatic deletion of pagelinks file +

+

+ This was a minor bug with building wikis by command-line import for historical wikis (for example, English Wikipedia from 2016-01). +

+

+ XOWA would automatically delete all .gz files after the wiki was built but before the search score was built. This deletion was part of some over-zelous cleanup which deleted all .gz files, not just those that have been used. The .gz-deletion crashed the command-line build because it caused the pagelinks file to be deleted before it was used. +

+

+ I never caught this because I always work with the current dumps. For current dumps, the XOWA command-line script has a command (util.download) which automatically unzips the .gz file to .sql. The deleted .gz file didn't affect the build because the .sql file was available. +

+

+ v3.7.4 now only deletes .gz file after it is used. +

+

+ Next release: v3.8.1 +

+

Release: POSTPONED (2016-07-24 23:00 Sun)

@@ -155,7 +256,7 @@ (Wiki) Publish 2016-07 French Wikipedia, Wiktionary, Wikisource, Wikivoyage, Wikiquote, Wikibooks, Wikiversity, and Wikinews

- The 2016-07 versions of the French Wikis are up. You can get them through Download Central. + The 2016-07 versions of the French Wikis are up. You can get them through Download Central.

(PC) Fix Redirects not working for HTML databases @@ -264,7 +365,7 @@ For those who are unaware, Mattze96 was the amazing developer who contributed the original HTTP Server code. This time, Mattze96 contributed mwad: the MediaWiki API dump tool. This tool allows creating XML dumps for Wikia and other wikis (https://wiki.archlinux.org/).

- If you use XOWA for Wikia wikis, or other non-Wikimedia wikis, you definitely want to try it out. For more info, see App/Import/mwad as well as https://github.com/Mattze96/mwad and https://github.com/gnosygnu/xowa/issues/66 + If you use XOWA for Wikia wikis, or other non-Wikimedia wikis, you definitely want to try it out. For more info, see App/Import/mwad as well as https://github.com/Mattze96/mwad and https://github.com/gnosygnu/xowa/issues/66

(PC) Fix minor Wikibase issues, including wikibase-item @@ -334,7 +435,7 @@ (Wiki) 2016-06 German Wiktionary, Wikisource, Wikivoyage, Wikiquote, Wikibooks, Wikiversity, and Wikinews

- These wikis are available at Download Central. + These wikis are available at Download Central.

(PC) Support Gallery @@ -366,7 +467,7 @@ There were a number of fixes for crashes in uncommon scenarios. Most of these involved switching SD cards, or deleting wikis outside XOWA. The crash was bad enough such that XOWA would not work unless the Storage files were cleared (or XOWA was reinstalled).

- These are fixed in this version. For more info, see the Change log + These are fixed in this version. For more info, see the Change log

Next release: v3.7.2 diff --git a/home/wiki/Blog/2016-07.html b/home/wiki/Blog/2016-07.html index 6f8e2b1fb..0635e2960 100644 --- a/home/wiki/Blog/2016-07.html +++ b/home/wiki/Blog/2016-07.html @@ -58,84 +58,185 @@ +

+ Release: v3.7.4.1 (2016-07-25 19:00 Mon) +

+

+ The PC version is a minor release. It fixes a build issue when building wikis from old dumps by command-line script. +

+

+ The Android version is a major release. It has a new screen to change the wiki location for Download Central +

+

+ (Wiki) Publish 2016-07 English Wikipedia +

+

+ The 2016-07 versions of English Wikipedia is up. You can get them through Download Central. +

+

+ For images, if you want the latest: +

+ +

+ For articles, if you want the latest: +

+ +

+ (Android) Add screen to change wiki location for Download Central +

+

+ First, some background. XOWA Android tries to use the external SD card for downloading wikis. Unfortunately, this is not easy, as different devices may have different paths for the external SD card (it varies by Android version as well as by manufacturer). If XOWA doesn't guess correctly, then the wikis will be downloaded to internal memory +

+

+ In v3.7.1, I added some logic to try to correctly detect the external SD card for one device (BLU on Android Lollipop). In the process, I ended up making the detection worse for other devices. +

+

+ v3.7.4 attempts to fix this by reverting back to the previous detection strategy. In addition, I also included a new "folder selection" screen to manually choose the external SD card. +

+

+ You can access this folder selection screen by clicking the "folder" icon in Download Central. Note that you will need to restart the app after you change the folder. +

+

+ Note that you can always manually download the wiki from archive.org and import them using the "XOWA file browser". The "XOWA file browser" is available through the "folder" icon on the "XOWA" Wikis page. +

+

+ (PC) Fix automatic deletion of pagelinks file +

+

+ This was a minor bug with building wikis by command-line import for historical wikis (for example, English Wikipedia from 2016-01). +

+

+ XOWA would automatically delete all .gz files after the wiki was built but before the search score was built. This deletion was part of some over-zelous cleanup which deleted all .gz files, not just those that have been used. The .gz-deletion crashed the command-line build because it caused the pagelinks file to be deleted before it was used. +

+

+ I never caught this because I always work with the current dumps. For current dumps, the XOWA command-line script has a command (util.download) which automatically unzips the .gz file to .sql. The deleted .gz file didn't affect the build because the .sql file was available. +

+

+ v3.7.4 now only deletes .gz file after it is used. +

+

+ Next release: v3.8.1 +

+

Release: POSTPONED (2016-07-24 23:00 Sun)

@@ -155,7 +256,7 @@ (Wiki) Publish 2016-07 French Wikipedia, Wiktionary, Wikisource, Wikivoyage, Wikiquote, Wikibooks, Wikiversity, and Wikinews

- The 2016-07 versions of the French Wikis are up. You can get them through Download Central. + The 2016-07 versions of the French Wikis are up. You can get them through Download Central.

(PC) Fix Redirects not working for HTML databases @@ -264,7 +365,7 @@ For those who are unaware, Mattze96 was the amazing developer who contributed the original HTTP Server code. This time, Mattze96 contributed mwad: the MediaWiki API dump tool. This tool allows creating XML dumps for Wikia and other wikis (https://wiki.archlinux.org/).

- If you use XOWA for Wikia wikis, or other non-Wikimedia wikis, you definitely want to try it out. For more info, see App/Import/mwad as well as https://github.com/Mattze96/mwad and https://github.com/gnosygnu/xowa/issues/66 + If you use XOWA for Wikia wikis, or other non-Wikimedia wikis, you definitely want to try it out. For more info, see App/Import/mwad as well as https://github.com/Mattze96/mwad and https://github.com/gnosygnu/xowa/issues/66

(PC) Fix minor Wikibase issues, including wikibase-item @@ -334,7 +435,7 @@ (Wiki) 2016-06 German Wiktionary, Wikisource, Wikivoyage, Wikiquote, Wikibooks, Wikiversity, and Wikinews

- These wikis are available at Download Central. + These wikis are available at Download Central.

(PC) Support Gallery @@ -366,7 +467,7 @@ There were a number of fixes for crashes in uncommon scenarios. Most of these involved switching SD cards, or deleting wikis outside XOWA. The crash was bad enough such that XOWA would not work unless the Storage files were cleared (or XOWA was reinstalled).

- These are fixed in this version. For more info, see the Change log + These are fixed in this version. For more info, see the Change log

Next release: v3.7.2 diff --git a/home/wiki/Change_log.html b/home/wiki/Change_log.html index 38bbcfd76..39e36a33a 100644 --- a/home/wiki/Change_log.html +++ b/home/wiki/Change_log.html @@ -36,7 +36,7 @@
  • - 2 v3.7.2.1 (2017-07-10) + 2 v3.7.4.1 (2017-07-25)
    • -
  • - 3 v3.7.2.1 (2017-07-10) +
  • + 3 v3.7.3.1 (2017-07-17)
    • -
  • - 4 v3.7.1.2 (2017-07-03) -
    • -
  • - 5 v3.7.1.1 (2017-07-03) +
  • + 4 v3.7.2.1 (2017-07-10)
    • +
  • + 5 v3.7.1.2 (2017-07-03) +
  • - 6 v3.6.4.2 (2016-06-27) + 6 v3.7.1.1 (2017-07-03) -
    • -
  • - 7 v3.6.4.1 (2016-06-25) - +
    • +
  • + 7 v3.6.4.2 (2016-06-27) +
    • -
  • - 8 v3.6.3.4 (2016-06-22) +
  • + 8 v3.6.4.1 (2016-06-25) -
    • -
  • - 9 v3.6.3.3 (2016-06-21) -
    • -
  • - 10 v3.6.3.2 (2016-06-20) +
  • + 9 v3.6.3.4 (2016-06-22) +
    • +
  • + 10 v3.6.3.3 (2016-06-21) +
    • -
  • - 11 v3.6.3.1 (2016-06-19) +
  • + 11 v3.6.3.2 (2016-06-20) +
    • +
  • + 12 v3.6.3.1 (2016-06-19) + -
    • -
  • - 12 v3.5.1.1 (2016-05-01) - -
    • -
  • - 13 v3.4.4.1 (2016-04-24) -
  • - 14 v3.4.3.1 (2016-04-17) + 13 v3.5.1.1 (2016-05-01) +
    • +
  • + 14 v3.4.4.1 (2016-04-24) +
    • -
  • - 15 v3.4.2.1 (2016-04-10) +
  • + 15 v3.4.3.1 (2016-04-17)
    • -
  • - 16 v3.4.1.1 (2016-04-04) +
  • + 16 v3.4.2.1 (2016-04-10)
    • -
  • - 17 Archives +
  • + 17 v3.4.1.1 (2016-04-04) + +
    • +
  • + 18 Archives
    • @@ -271,18 +288,97 @@ The most important category to review is major. The other categories may be skipped due to lower importance (if they were more important, they would be bumped up to major).

    - v3.7.2.1 (2017-07-10) + v3.7.4.1 (2017-07-25)

    Wiki

    + +

    + PC +

    +

    + minor +

    + +

    + trivial +

    + +
    +
    + Example: /home/wiki/Main_Page#Links. +
    +
    + +
    +
    + Resolved by: Invalidate all Scribunto engines across all wikis when disabled. +
    +
    + Links: Options/Scribunto +
    +
    + +
    +
    + Resolved by: Only show last 1 MB of log file in browser. +
    +
    +

    + Android +

    + + +

    + Dev +

    + +

    + v3.7.3.1 (2017-07-17) +

    +

    + Wiki +

    - PC + PC

    major @@ -387,7 +483,7 @@

    - Dev + Dev

    - v3.7.2.1 (2017-07-10) + v3.7.2.1 (2017-07-10)

    - Wiki + Wiki

    - PC + PC

    major @@ -433,7 +529,7 @@

    - Links: App/Import/mwad + Links: App/Import/mwad
    - Links: Special:XowaWikiInfo?wiki=simple.wikipedia.org + Links: Special:XowaWikiInfo?wiki=simple.wikipedia.org

    @@ -505,7 +601,7 @@

    - Android + Android

    minor @@ -516,7 +612,7 @@

    - Dev + Dev

    - Links: App/Setup/Installation App/Setup/Flash_card App/Xtn/Browser/XOWA_viewer + Links: App/Setup/Installation App/Setup/Flash_card App/Xtn/Browser/XOWA_viewer
    - Links: Dashboard/Import/Offline + Links: Dashboard/Import/Offline
    - Links: Help/Privacy/Android + Links: Help/Privacy/Android

    - Dev + Dev

    - Links: Dashboard/Wiki_maintenance + Links: Dashboard/Wiki_maintenance

    @@ -1677,7 +1773,7 @@

    - Android + Android

    major.fix @@ -1742,7 +1838,7 @@ Resolved by: Pass display_title info to new page_banner manager.

    - Links: http://en.wikipedia.org/wiki/gzip Diagnostics/ParserFunctions/DisplayTitle + Links: http://en.wikipedia.org/wiki/gzip Diagnostics/ParserFunctions/DisplayTitle
    - Links: Diagnostics/Xtns/Wikia/All + Links: Diagnostics/Xtns/Wikia/All
    - Links: Diagnostics/Xtns/Wikia/All + Links: Diagnostics/Xtns/Wikia/All
    - Links: Diagnostics/Xtns/Wikia/All + Links: Diagnostics/Xtns/Wikia/All


    - Android + Android

    major.add @@ -1985,7 +2081,7 @@

    - Links: Dashboard/Import/Offline + Links: Dashboard/Import/Offline
    - Links: Dashboard/Files/Deletion + Links: Dashboard/Files/Deletion

    @@ -2036,16 +2132,16 @@

    diff --git a/home/wiki/Change_log/v3.7.4.1.html b/home/wiki/Change_log/v3.7.4.1.html new file mode 100644 index 000000000..47d842096 --- /dev/null +++ b/home/wiki/Change_log/v3.7.4.1.html @@ -0,0 +1,227 @@ + + + + + Change log/v3.7.4.1 - XOWA + + + + + +
    +
    +
    +

    Change log/v3.7.4.1

    +
    +
    From XOWA: the free, open-source, offline wiki application
    +
    +
    + +
    +
    +

    + Contents +

    +
    + +
    +

    + v3.7.4.1 (2017-07-25) +

    +

    + Wiki +

    +
      +
    • + Wiki: Publish 2016-07 English Wikipedia +
      • +
    +

    + PC +

    +

    + minor +

    +
      +
    • + Command-line: Fix automatic deletion of pagelinks file. {detected by anonymous} +
      • +
    +

    + trivial +

    +
      +
    • + Gui: Do not show blank page when restoring page with anchor at application startup. +
      • +
    +
    +
    + Example: /home/wiki/Main_Page#Links. +
    +
    +
      +
    • + Options: Immediately update Enabled flag in Options/Scribunto (instead of forcing reboot). +
      • +
    +
    +
    + Resolved by: Invalidate all Scribunto engines across all wikis when disabled. +
    +
    + Links: Options/Scribunto +
    +
    +
      +
    • + Log: Do not fail with OutOfMemoryError when loading Special:XowaSystemData. +
      • +
    +
    +
    + Resolved by: Only show last 1 MB of log file in browser. +
    +
    +

    + Android +

    +
      +
    • + DownloadCentral: Add screen to change wiki location for XOWA app. +
      • +
    +
      +
    • + DownloadCentral: If unzip fails, restart from verify, not unzip. +
      • +
    +

    + Dev +

    +
      +
    • + Source: Fix thread-safe issues with wikibase and html generation. +
      • +
    + +
    +
    +
    + + +
    +
    +
    +

    Namespaces

    + +
    +
    +
    + +
    + +
    +

    XOWA

    +
    + +
    +
    + +
    +

    Getting started

    +
    + +
    +
    + +
    +

    Android

    +
    + +
    +
    + +
    +

    Help

    +
    + +
    +
    + +
    +

    Blog

    +
    + +
    +
    + + + +
    +

    Donate

    +
    + +
    +
    + +
    + + \ No newline at end of file diff --git a/home/wiki/Dashboard/Wiki_maintenance.html b/home/wiki/Dashboard/Wiki_maintenance.html index f5242c29d..bc08fcc9f 100644 --- a/home/wiki/Dashboard/Wiki_maintenance.html +++ b/home/wiki/Dashboard/Wiki_maintenance.html @@ -150,6 +150,41 @@ + + + de.wikipedia.org + + + y + + + 1969-12-31 + + + 2015-08-06 + + + Dump complete + + + xdat + + + v1 + + + v2 + + + + + + + + + + + en.wikipedia.org diff --git a/home/wiki/Dev/Command-line/Dumps.html b/home/wiki/Dev/Command-line/Dumps.html index 6c5b0baa2..56e6e04a7 100644 --- a/home/wiki/Dev/Command-line/Dumps.html +++ b/home/wiki/Dev/Command-line/Dumps.html @@ -105,7 +105,10 @@
  • - 5 Script + 5 Script: Simple Wikipedia example with documentation +
    • +
  • + 6 Script: gnosygnu's actual English Wikipedia script (dirty; provided for reference only)
    • @@ -293,7 +296,7 @@

    - Script + Script: Simple Wikipedia example with documentation 

     app.bldr.pause_at_end_('n');
@@ -457,6 +460,125 @@ app.bldr.cmds {
   add     ('simple.wikipedia.org' , 'wiki.page_dump.drop');
 }
 app.bldr.run;
+
    +

    + Script: gnosygnu's actual English Wikipedia script (dirty; provided for reference only) +

    +
    +app.bldr.pause_at_end_('n');
+app.scripts.run_file_by_type('xowa_cfg_app');
+app.cfgs.get('app.user.cfg.security.web_access_enabled', 'app').val = 'n';
+app.bldr.cmds {
+/*
+  add     ('www.wikidata.org' , 'util.cleanup')          {delete_all = 'y';}
+  add     ('www.wikidata.org' , 'util.download')         {dump_type = 'pages-articles';}
+  add     ('www.wikidata.org' , 'util.download')         {dump_type = 'categorylinks';}
+  add     ('www.wikidata.org' , 'util.download')         {dump_type = 'page_props';}
+  add     ('www.wikidata.org' , 'util.download')         {dump_type = 'image';}
+  add     ('www.wikidata.org' , 'text.init');
+  add     ('www.wikidata.org' , 'text.page');
+  add     ('www.wikidata.org' , 'text.cat.core');
+  add     ('www.wikidata.org' , 'text.cat.link');
+  add     ('www.wikidata.org' , 'text.cat.hidden');
+  add     ('www.wikidata.org' , 'text.term');
+  add     ('www.wikidata.org' , 'text.css');
+  add     ('www.wikidata.org' , 'wiki.image');
+  add     ('www.wikidata.org' , 'file.page_regy')        {build_commons = 'y'}
+  add     ('www.wikidata.org' , 'wiki.page_dump.make');
+  add     ('www.wikidata.org' , 'wiki.redirect')         {commit_interval = 1000; progress_interval = 100; cleanup_interval = 100;}
+  add     ('www.wikidata.org' , 'util.cleanup')          {delete_tmp = 'y'; delete_by_match('*.xml|*.sql|*.bz2|*.gz');}
+  add     ('commons.wikimedia.org' , 'util.cleanup')          {delete_all = 'y';}
+  add     ('commons.wikimedia.org' , 'util.download')         {dump_type = 'pages-articles';}
+  add     ('commons.wikimedia.org' , 'util.download')         {dump_type = 'categorylinks';}
+  add     ('commons.wikimedia.org' , 'util.download')         {dump_type = 'page_props';}
+  add     ('commons.wikimedia.org' , 'util.download')         {dump_type = 'image';}
+  add     ('commons.wikimedia.org' , 'text.init');
+  add     ('commons.wikimedia.org' , 'text.page');
+  add     ('commons.wikimedia.org' , 'text.cat.core');
+  add     ('commons.wikimedia.org' , 'text.cat.link');
+  add     ('commons.wikimedia.org' , 'text.cat.hidden');
+  add     ('commons.wikimedia.org' , 'text.term');
+  add     ('commons.wikimedia.org' , 'text.css');
+  add     ('commons.wikimedia.org' , 'wiki.image');
+  add     ('commons.wikimedia.org' , 'file.page_regy')        {build_commons = 'y'}
+  add     ('commons.wikimedia.org' , 'wiki.page_dump.make');
+  add     ('commons.wikimedia.org' , 'wiki.redirect')         {commit_interval = 1000; progress_interval = 100; cleanup_interval = 100;}
+*/
+/*
+  // en.wikipedia.org
+  add     ('en.wikipedia.org' , 'util.download')         {dump_type = 'pages-articles';}
+  add     ('en.wikipedia.org' , 'util.download')         {dump_type = 'categorylinks';}
+  add     ('en.wikipedia.org' , 'util.download')         {dump_type = 'page_props';}
+  add     ('en.wikipedia.org' , 'util.download')         {dump_type = 'image';}
+  add     ('en.wikipedia.org' , 'util.download')         {dump_type = 'pagelinks';}
+*/
+/*
+  add     ('en.wikipedia.org' , 'text.init');
+  add     ('en.wikipedia.org' , 'text.page')             {redirect_id_enabled = 'y';}
+  add     ('en.wikipedia.org' , 'text.search');
+  add     ('en.wikipedia.org' , 'text.css');
+  add     ('en.wikipedia.org' , 'text.cat.core');
+  add     ('en.wikipedia.org' , 'text.cat.link');
+  add     ('en.wikipedia.org' , 'text.cat.hidden');
+  add     ('en.wikipedia.org' , 'text.term');
+//  add     ('en.wikipedia.org' , 'wiki.redirect')         {commit_interval = 1000; progress_interval = 100; cleanup_interval = 100;}
+  add     ('en.wikipedia.org' , 'wiki.image');
+  add     ('en.wikipedia.org' , 'wiki.page_dump.make');
+  add     ('en.wikipedia.org' , 'wiki.page_link');
+  add     ('en.wikipedia.org' , 'search.page__page_score') {iteration_max = 100;}
+  add     ('en.wikipedia.org' , 'search.link__link_score') {page_rank_enabled = 'y';
+    score_adjustment_mgr {
+      match_mgr {
+        get(0) {
+          add('bgn', 'mult', '.999', 'List_of_', 'National_Register_of_Historic_Places_listings_');
+          add('end', 'mult', '.999', '_United_States_Census');
+          add('all', 'mult', '.999', 'Copyright_infringement', 'Time_zone', 'Daylight_saving_time');
+          add('all', 'add' , '0'   , 'Animal');
+        }
+      }
+    }
+  }
+  add     ('en.wikipedia.org' , 'search.word__link_count')
+/*
+  // SELECT * FROM xowa_cfg WHERE cfg_key = 'props.modified_latest';
+  add     ('en.wikipedia.org' , 'file.lnki_temp') {
+    commit_interval = 10000; progress_interval = 50; cleanup_interval = 50; select_size = 25;
+    ns_ids = '0|4|14|100';
+    hdump_bldr {enabled = 'y'; hzip_enabled = 'y'; hzip_diff = 'y';}
+  }  
+  add     ('en.wikipedia.org' , 'file.lnki_regy');
+  add     ('commons.wikimedia.org' , 'file.page_regy')        {build_commons = 'y'}
+  add     ('en.wikipedia.org'      , 'file.page_regy')        {build_commons = 'n';}
+  add     ('en.wikipedia.org' , 'wiki.image');
+  add     ('en.wikipedia.org' , 'file.orig_regy');
+  // SELECT * FROM orig_regy WHERE lnki_ttl = 'BSicon_CONTr.svg';
+  // SELECT * FROM page_regy WHERE src_ttl = 'BSicon_CONTr.svg';
+  add     ('en.wikipedia.org' , 'file.xfer_temp.thumb');
+  // SELECT Count(*) FROM xfer_regy WHERE xfer_status = 0;
+  // SELECT * FROM xfer_regy WHERE xfer_status = 0 AND lnki_page_id = 372692; --en.w:Featured_picture_candidates
+  add     ('en.wikipedia.org' , 'file.xfer_regy');
+*/
+/*
+  add     ('en.wikipedia.org' , 'file.xfer_regy_update');
+  add     ('en.wikipedia.org' , 'file.fsdb_make') {
+    commit_interval = 1000; progress_interval = 200; select_interval = 10000;
+    ns_ids = '0|4|14|100';
+//    // specify whether original wiki databases are v1 (.sqlite3) or v2 (.xowa)
+//    // src_bin_mgr__fsdb_version = 'v2';
+
+//   trg_bin_mgr__fsdb_version = 'v1';
+
+    // always redownload certain files
+    src_bin_mgr__fsdb_skip_wkrs = 'page_gt_1|small_size';
+    
+    // allow downloads from wikimedia
+    src_bin_mgr__wmf_enabled = 'y';
+  }
+  add     ('en.wikipedia.org' , 'file.orig_reg');
+  add     ('en.wikipedia.org' , 'wiki.page_dump.drop');
+*/
+}
+app.bldr.run;
    diff --git a/home/wiki/Dev/Command-line/Thumbs.html b/home/wiki/Dev/Command-line/Thumbs.html index 2c4e2c5a4..901134d85 100644 --- a/home/wiki/Dev/Command-line/Thumbs.html +++ b/home/wiki/Dev/Command-line/Thumbs.html @@ -105,7 +105,10 @@
  • - 5 Script + 5 Script: Simple Wikipedia example with documentation +
    • +
  • + 6 Script: gnosygnu's actual English Wikipedia script (dirty; provided for reference only)
    • @@ -293,7 +296,7 @@

    - Script + Script: Simple Wikipedia example with documentation 

     app.bldr.pause_at_end_('n');
@@ -457,6 +460,125 @@ app.bldr.cmds {
   add     ('simple.wikipedia.org' , 'wiki.page_dump.drop');
 }
 app.bldr.run;
+
    +

    + Script: gnosygnu's actual English Wikipedia script (dirty; provided for reference only) +

    +
    +app.bldr.pause_at_end_('n');
+app.scripts.run_file_by_type('xowa_cfg_app');
+app.cfgs.get('app.user.cfg.security.web_access_enabled', 'app').val = 'n';
+app.bldr.cmds {
+/*
+  add     ('www.wikidata.org' , 'util.cleanup')          {delete_all = 'y';}
+  add     ('www.wikidata.org' , 'util.download')         {dump_type = 'pages-articles';}
+  add     ('www.wikidata.org' , 'util.download')         {dump_type = 'categorylinks';}
+  add     ('www.wikidata.org' , 'util.download')         {dump_type = 'page_props';}
+  add     ('www.wikidata.org' , 'util.download')         {dump_type = 'image';}
+  add     ('www.wikidata.org' , 'text.init');
+  add     ('www.wikidata.org' , 'text.page');
+  add     ('www.wikidata.org' , 'text.cat.core');
+  add     ('www.wikidata.org' , 'text.cat.link');
+  add     ('www.wikidata.org' , 'text.cat.hidden');
+  add     ('www.wikidata.org' , 'text.term');
+  add     ('www.wikidata.org' , 'text.css');
+  add     ('www.wikidata.org' , 'wiki.image');
+  add     ('www.wikidata.org' , 'file.page_regy')        {build_commons = 'y'}
+  add     ('www.wikidata.org' , 'wiki.page_dump.make');
+  add     ('www.wikidata.org' , 'wiki.redirect')         {commit_interval = 1000; progress_interval = 100; cleanup_interval = 100;}
+  add     ('www.wikidata.org' , 'util.cleanup')          {delete_tmp = 'y'; delete_by_match('*.xml|*.sql|*.bz2|*.gz');}
+  add     ('commons.wikimedia.org' , 'util.cleanup')          {delete_all = 'y';}
+  add     ('commons.wikimedia.org' , 'util.download')         {dump_type = 'pages-articles';}
+  add     ('commons.wikimedia.org' , 'util.download')         {dump_type = 'categorylinks';}
+  add     ('commons.wikimedia.org' , 'util.download')         {dump_type = 'page_props';}
+  add     ('commons.wikimedia.org' , 'util.download')         {dump_type = 'image';}
+  add     ('commons.wikimedia.org' , 'text.init');
+  add     ('commons.wikimedia.org' , 'text.page');
+  add     ('commons.wikimedia.org' , 'text.cat.core');
+  add     ('commons.wikimedia.org' , 'text.cat.link');
+  add     ('commons.wikimedia.org' , 'text.cat.hidden');
+  add     ('commons.wikimedia.org' , 'text.term');
+  add     ('commons.wikimedia.org' , 'text.css');
+  add     ('commons.wikimedia.org' , 'wiki.image');
+  add     ('commons.wikimedia.org' , 'file.page_regy')        {build_commons = 'y'}
+  add     ('commons.wikimedia.org' , 'wiki.page_dump.make');
+  add     ('commons.wikimedia.org' , 'wiki.redirect')         {commit_interval = 1000; progress_interval = 100; cleanup_interval = 100;}
+*/
+/*
+  // en.wikipedia.org
+  add     ('en.wikipedia.org' , 'util.download')         {dump_type = 'pages-articles';}
+  add     ('en.wikipedia.org' , 'util.download')         {dump_type = 'categorylinks';}
+  add     ('en.wikipedia.org' , 'util.download')         {dump_type = 'page_props';}
+  add     ('en.wikipedia.org' , 'util.download')         {dump_type = 'image';}
+  add     ('en.wikipedia.org' , 'util.download')         {dump_type = 'pagelinks';}
+*/
+/*
+  add     ('en.wikipedia.org' , 'text.init');
+  add     ('en.wikipedia.org' , 'text.page')             {redirect_id_enabled = 'y';}
+  add     ('en.wikipedia.org' , 'text.search');
+  add     ('en.wikipedia.org' , 'text.css');
+  add     ('en.wikipedia.org' , 'text.cat.core');
+  add     ('en.wikipedia.org' , 'text.cat.link');
+  add     ('en.wikipedia.org' , 'text.cat.hidden');
+  add     ('en.wikipedia.org' , 'text.term');
+//  add     ('en.wikipedia.org' , 'wiki.redirect')         {commit_interval = 1000; progress_interval = 100; cleanup_interval = 100;}
+  add     ('en.wikipedia.org' , 'wiki.image');
+  add     ('en.wikipedia.org' , 'wiki.page_dump.make');
+  add     ('en.wikipedia.org' , 'wiki.page_link');
+  add     ('en.wikipedia.org' , 'search.page__page_score') {iteration_max = 100;}
+  add     ('en.wikipedia.org' , 'search.link__link_score') {page_rank_enabled = 'y';
+    score_adjustment_mgr {
+      match_mgr {
+        get(0) {
+          add('bgn', 'mult', '.999', 'List_of_', 'National_Register_of_Historic_Places_listings_');
+          add('end', 'mult', '.999', '_United_States_Census');
+          add('all', 'mult', '.999', 'Copyright_infringement', 'Time_zone', 'Daylight_saving_time');
+          add('all', 'add' , '0'   , 'Animal');
+        }
+      }
+    }
+  }
+  add     ('en.wikipedia.org' , 'search.word__link_count')
+/*
+  // SELECT * FROM xowa_cfg WHERE cfg_key = 'props.modified_latest';
+  add     ('en.wikipedia.org' , 'file.lnki_temp') {
+    commit_interval = 10000; progress_interval = 50; cleanup_interval = 50; select_size = 25;
+    ns_ids = '0|4|14|100';
+    hdump_bldr {enabled = 'y'; hzip_enabled = 'y'; hzip_diff = 'y';}
+  }  
+  add     ('en.wikipedia.org' , 'file.lnki_regy');
+  add     ('commons.wikimedia.org' , 'file.page_regy')        {build_commons = 'y'}
+  add     ('en.wikipedia.org'      , 'file.page_regy')        {build_commons = 'n';}
+  add     ('en.wikipedia.org' , 'wiki.image');
+  add     ('en.wikipedia.org' , 'file.orig_regy');
+  // SELECT * FROM orig_regy WHERE lnki_ttl = 'BSicon_CONTr.svg';
+  // SELECT * FROM page_regy WHERE src_ttl = 'BSicon_CONTr.svg';
+  add     ('en.wikipedia.org' , 'file.xfer_temp.thumb');
+  // SELECT Count(*) FROM xfer_regy WHERE xfer_status = 0;
+  // SELECT * FROM xfer_regy WHERE xfer_status = 0 AND lnki_page_id = 372692; --en.w:Featured_picture_candidates
+  add     ('en.wikipedia.org' , 'file.xfer_regy');
+*/
+/*
+  add     ('en.wikipedia.org' , 'file.xfer_regy_update');
+  add     ('en.wikipedia.org' , 'file.fsdb_make') {
+    commit_interval = 1000; progress_interval = 200; select_interval = 10000;
+    ns_ids = '0|4|14|100';
+//    // specify whether original wiki databases are v1 (.sqlite3) or v2 (.xowa)
+//    // src_bin_mgr__fsdb_version = 'v2';
+
+//   trg_bin_mgr__fsdb_version = 'v1';
+
+    // always redownload certain files
+    src_bin_mgr__fsdb_skip_wkrs = 'page_gt_1|small_size';
+    
+    // allow downloads from wikimedia
+    src_bin_mgr__wmf_enabled = 'y';
+  }
+  add     ('en.wikipedia.org' , 'file.orig_reg');
+  add     ('en.wikipedia.org' , 'wiki.page_dump.drop');
+*/
+}
+app.bldr.run;
    diff --git a/home/wiki/Help/Download_XOWA.html b/home/wiki/Help/Download_XOWA.html index 5c8457194..0df7a24a6 100644 --- a/home/wiki/Help/Download_XOWA.html +++ b/home/wiki/Help/Download_XOWA.html @@ -28,10 +28,10 @@

    @@ -39,10 +39,10 @@

    @@ -50,10 +50,10 @@

    @@ -61,7 +61,7 @@

    @@ -69,7 +69,7 @@

    @@ -77,7 +77,7 @@

    @@ -89,127 +89,82 @@

    - v3.7.2.1 (2017-07-10) + v3.7.4.1 (2017-07-25)

    Wiki

    PC

    -

    - major -

    - -
    -
    - Links: https://fr.wikibooks.org/wiki/Portrait https://fr.wikiquote.org/wiki/ https://fr.wikiquote.org/wiki/Paul_%C3%89luard -
    -
    - -
    -
    - Resolved by: Rewrite TOC generator. -
    -
    - Example: ==a<br/>b==. -
    -
    - Links: https://fr.wikipedia.org/wiki/Thermokarst https://fr.wikipedia.org/wiki/Conseil_régional_du_Nord-Pas-de-Calais https://fr.wikipedia.org/wiki/Tour_de_ski_2007-2008 -
    -
    - -
    -
    - Resolved by: Rewrite TOC generator. -
    -
    - Example: ==a== ==a==. -
    -
    - Links: https://fr.wikipedia.org/wiki/Itanium https://fr.wikipedia.org/wiki/10000 https://fr.wikipedia.org/wiki/Liste_des_microprocesseurs_Intel https://fr.wikipedia.org/wiki/Technology_and_Entertainment_Software -
    -
    - -
    -
    - Resolved by: Rewrite TOC generator. -
    -
    - Example: ==a<ref name="b">c==. -
    -
    - Links: https://fr.wikipedia.org/wiki/Dal -
    -
    - -
    -
    - Links: https://en.wikivoyage.org/wiki/Paris -
    -

    minor

    +

    + trivial +

    - Resolved by: Update failover.css to use recent versions. -
    -
    - Links: https://en.wikipedia.org/wiki/Earth + Example: /home/wiki/Main_Page#Links.
    - Resolved by: Ignore duplicate item in page history. + Resolved by: Invalidate all Scribunto engines across all wikis when disabled. +
    +
    + Links: Options/Scribunto
    + +
    +
    + Resolved by: Only show last 1 MB of log file in browser. +
    +
    +

    + Android +

    + +

    Dev

    diff --git a/home/wiki/Main_Page.html b/home/wiki/Main_Page.html index 9579fe6f6..892621d08 100644 --- a/home/wiki/Main_Page.html +++ b/home/wiki/Main_Page.html @@ -82,17 +82,17 @@ Release notes

    - v3.7.3.1 features the following: + v3.7.4.1 features the following:

    diff --git a/home/wiki/Options/HTML_databases.html b/home/wiki/Options/HTML_databases.html index 3760e73e7..45f2aeaec 100644 --- a/home/wiki/Options/HTML_databases.html +++ b/home/wiki/Options/HTML_databases.html @@ -305,7 +305,7 @@ li.active a, li.active a:hover for Read tab: [1] - +