You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
gnosygnu_xowa/home/wiki/Blog/2017-01.html

363 lines
19 KiB

<!DOCTYPE html>
<html dir="ltr">
<head>
<meta http-equiv="content-type" content="text/html;charset=UTF-8" />
<title>Blog/2017-01 - XOWA</title>
<link rel="shortcut icon" href="https://gnosygnu.github.io/xowa/xowa_logo.png" />
<link rel="stylesheet" href="https://gnosygnu.github.io/xowa/xowa_common.css" type="text/css">
</head>
<body class="mediawiki ltr sitedir-ltr ns-0 ns-subject skin-vector action-submit vector-animateLayout" spellcheck="false">
<div id="mw-page-base" class="noprint"></div>
<div id="mw-head-base" class="noprint"></div>
<div id="content" class="mw-body">
<h1 id="firstHeading" class="firstHeading"><span>Blog/2017-01</span></h1>
<div id="bodyContent" class="mw-body-content">
<div id="siteSub">From XOWA: the free, open-source, offline wiki application</div>
<div id="contentSub"></div>
<div id="mw-content-text" lang="en" dir="ltr" class="mw-content-ltr">
<div class='infobox plainlinks' style='width:70px;'>
<p>
<span style='font-size:15px;font-weight:bold;'>Blog links</span><br>
<br>
2019<br>
</p>
<ul>
<li>
<a href="/wiki/Blog/2019-07" id="xolnki_2" title="Blog/2019-07">2019-07</a>
</li>
<li>
<a href="/wiki/Blog/2019-03" id="xolnki_3" title="Blog/2019-03">2019-03</a>
</li>
</ul>
<p>
2018<br>
</p>
<ul>
<li>
<a href="/wiki/Blog/2018-01" id="xolnki_4" title="Blog/2018-01">2018-01</a>
</li>
</ul>
<p>
2017<br>
</p>
<ul>
<li>
<a href="/wiki/Blog/2017-09" id="xolnki_5" title="Blog/2017-09">2017-09</a>
</li>
<li>
<a href="/wiki/Blog/2017-06" id="xolnki_6" title="Blog/2017-06">2017-06</a>
</li>
</ul>
<p>
<br>
<a href="/wiki/Blog/Archives" id="xolnki_7" title="Blog/Archives">Archives</a>
</p>
</div>
<div id="toc" class="toc">
<div id="toctitle" class="toctitle">
<h2>
Contents
</h2>
</div>
<ul>
<li class="toclevel-1 tocsection-1">
<a href="#Personal:_Vacation_and_limited_reachability_(2017-01-13_17:00_Fri)"><span class="tocnumber">1</span> <span class="toctext">Personal: Vacation and limited reachability (2017-01-13 17:00 Fri)</span></a>
</li>
<li class="toclevel-1 tocsection-2">
<a href="#Release:_NONE_(2017-01-08_10:30_Sun)"><span class="tocnumber">2</span> <span class="toctext">Release: NONE (2017-01-08 10:30 Sun)</span></a>
</li>
<li class="toclevel-1 tocsection-3">
<a href="#Release:_v4.0.0.1701_(2017-01-04_21:00_Tue)"><span class="tocnumber">3</span> <span class="toctext">Release: v4.0.0.1701 (2017-01-04 21:00 Tue)</span></a>
<ul>
<li class="toclevel-2 tocsection-4">
<a href="#(Wiki)_Publish_2016-12_Italian_and_Swahili_wikis._Also,_2016-12_English_Wikipedia"><span class="tocnumber">3.1</span> <span class="toctext">(Wiki) Publish 2016-12 Italian and Swahili wikis. Also, 2016-12 English Wikipedia</span></a>
</li>
<li class="toclevel-2 tocsection-5">
<a href="#(PC)_Add_new_Options_system"><span class="tocnumber">3.2</span> <span class="toctext">(PC) Add new Options system</span></a>
</li>
<li class="toclevel-2 tocsection-6">
<a href="#(PC)_Change_versioning_scheme_to_semantic_versioning"><span class="tocnumber">3.3</span> <span class="toctext">(PC) Change versioning scheme to semantic versioning</span></a>
</li>
<li class="toclevel-2 tocsection-7">
<a href="#(PC)_Fix_mass_parse_performance_issues_when_generating_English_Wikipedia"><span class="tocnumber">3.4</span> <span class="toctext">(PC) Fix mass parse performance issues when generating English Wikipedia</span></a>
</li>
<li class="toclevel-2 tocsection-8">
<a href="#Next_week:_v4.0.1.1701"><span class="tocnumber">3.5</span> <span class="toctext">Next week: v4.0.1.1701</span></a>
</li>
</ul>
</li>
<li class="toclevel-1 tocsection-9">
<a href="#Release:_POSTPONED_(2017-01-03_01:30_Tue)"><span class="tocnumber">4</span> <span class="toctext">Release: POSTPONED (2017-01-03 01:30 Tue)</span></a>
</li>
</ul>
</div>
<h2>
<span class="mw-headline" id="Personal:_Vacation_and_limited_reachability_(2017-01-13_17:00_Fri)">Personal: Vacation and limited reachability (2017-01-13 17:00 Fri)</span>
</h2>
<p>
I'm going to be out on vacation for about a week and a half. I'll only have limited access to the internet, and won't be able to make any releases.
</p>
<p>
If there are any issues, please do post to <a href="https://github.com/gnosygnu/xowa/issues" rel="nofollow" class="external free">https://github.com/gnosygnu/xowa/issues</a>
</p>
<p>
Otherwise, I'll resume when I return.
</p>
<p>
Thanks!
</p>
<h2>
<span class="mw-headline" id="Release:_NONE_(2017-01-08_10:30_Sun)">Release: NONE (2017-01-08 10:30 Sun)</span>
</h2>
<p>
I'm skipping the release for tonight. There was one regression issue introduced last week: Random not working in HTML databases. However, that can be fixed with an options change: <a href="https://github.com/gnosygnu/xowa/issues/121#issuecomment-270473393" rel="nofollow" class="external free">https://github.com/gnosygnu/xowa/issues/121#issuecomment-270473393</a>
</p>
<p>
I'm going to be out on vacation for the next two weeks, so the next possible release is 1-29.
</p>
<p>
Also, I ran into an issue with 2017-01 English Wikipedia. Unfortunately that will also be postponed till near end of month as well.
</p>
<h2>
<span class="mw-headline" id="Release:_v4.0.0.1701_(2017-01-04_21:00_Tue)">Release: v4.0.0.1701 (2017-01-04 21:00 Tue)</span>
</h2>
<p>
The PC version is a major release. It adds a new Option system and includes a lot of related changes.
</p>
<p>
The Android version has no release.
</p>
<h3>
<span class="mw-headline" id="(Wiki)_Publish_2016-12_Italian_and_Swahili_wikis._Also,_2016-12_English_Wikipedia">(Wiki) Publish 2016-12 Italian and Swahili wikis. Also, 2016-12 English Wikipedia</span>
</h3>
<p>
2016-12 Italian and Swahili wikis are up at archive.org. 2016-12 English Wikipedia was also pushed out earlier this month.
</p>
<p>
To download these wikis, please check <a href="/wiki/Wiki_setup/Listing" id="xolnki_8" title="Wiki setup/Listing">Wiki_setup/Listing</a> or <a href="/wiki/Special:XowaDownloadCentral" id="xolnki_9" title="Special:XowaDownloadCentral">Special:XowaDownloadCentral</a>
</p>
<h3>
<span class="mw-headline" id="(PC)_Add_new_Options_system">(PC) Add new <a href="/wiki/Options" id="xolnki_10" title="Options">Options</a> system</span>
</h3>
<p>
The major change for this release was the Options system. It was a multi-week effort that overhauled various parts of the system. You can try the new Options systems at the <a href="/wiki/Options" id="xolnki_11" title="Options">Options</a> page
</p>
<p>
There were a number of reasons for the change:
</p>
<ul>
<li>
<b>Android compatible</b>: The previous Options system was not Android compatible. It relied on Wikitext (which XOWA Android doesn't support), and had a very desktop-centric UI design (wide tabstrip; hover tooltips). The new Options system addresses these issues and uses a common codebase for both desktop and Android.
</li>
<li>
<b>Multiple wiki support</b>: The previous Options system used one set of options for all wikis. Individual wikis couldn't have options different from another wiki (actually, they could, but in a very indirect way). The new Options system supports multiple wikis out-of-box, though at current, it's only used for one option (variant choice in Chinese / Serbian wikis)
</li>
<li>
<b>Technical upgrades</b>: The previous Options system was a hodge-podge of Wikitext and XOWA-specific extensions. The new Options systems standardizes data-storage in SQLite, generates pages through one Special extension, uses a good deal of CSS to display HTML, and offers dynamic interaction via AJAX. Overall, it should be a more web-like and pleasant user-experience
</li>
</ul>
<p>
Because the scope of the change was so sweeping, there may be a number of issues. If you run into problems, please try the following:
</p>
<ul>
<li>
<b>user_system.gfs</b>: XOWA tries to convert existing options at /xowa/user/anonymous/app/data/cfg/user_system_cfg.gfs. If you're missing an option, you can try checking there
</li>
<li>
<b>xowa_cfg_os.gfs</b>: XOWA also stores Operating System specific options at /xowa/bin/[OS_NAME]/xowa/cfg/xowa_cfg_os.gfs. The new version now uses a different file: /xowa/user/app/cfg/os.gfs. If you've manually customized options here, you will need to reapply them
</li>
<li>
<b>Missing options</b>: A handful of options were not converted. For more detail, see <a href="/wiki/Change_log" id="xolnki_12" title="Change log">Change_log</a>
</li>
</ul>
<p>
Of course, if you run into issues, please let me know at <a href="https://github.com/gnosygnu/xowa/issues" rel="nofollow" class="external free">https://github.com/gnosygnu/xowa/issues</a> I'm hoping though that this will be a pleasant, uneventful change.
</p>
<h3>
<span class="mw-headline" id="(PC)_Change_versioning_scheme_to_semantic_versioning">(PC) Change versioning scheme to semantic versioning</span>
</h3>
<p>
Since the start, XOWA used a date-of-release versioning scheme. For example, version 3.12.2.1 meant the version released in the 3rd year after XOWA's release, in the 12th month and the 2nd week.
</p>
<p>
XOWA is now adopting a new versioining scheme closer to <a href="https://en.wikipedia.org/wiki/Software_versioning#Degree_of_compatibility" rel="nofollow" class="external text">semantic versioning</a>. Specifically:
</p>
<ul>
<li>
In the previous scheme, this version would be 4.1.1.1.
</li>
<li>
In the new scheme, this version is 4.0.0.1701
</li>
</ul>
<p>
As an overview:
</p>
<ul>
<li>
The 1st number indicates a major version. For example, 4. This number won't change unless there is a drastically new change, or after there's a lot of significant changes.
</li>
<li>
The 2nd number indicates a minor version. For example, 0. This number will change whenever there is a new significant feature or change.
</li>
<li>
The 3rd number indicates a patch version. For example, 0. This number will change whenever there is a new release.
</li>
<li>
The 4th number indicates a system version. For example, 1701. This number is related to the release date in year / month format: 20<b>17</b>-<b>01</b>.
</li>
</ul>
<p>
In terms of upgrade strategies:
</p>
<ul>
<li>
If you're a casual user, you can wait on upgrading until the major version changes. When "5.0" comes out you should probably get it, as it should be significantly different than the current version. This will probably not come out for a year or more.
</li>
<li>
If you're an active user, you can wait on upgrading until the minor version changes: "4.1", "4.2", "4.3", etc.. Each minor release will have a new significant feature or change. These will probably come out at monthly intervals.
</li>
<li>
If you're a cutting-edge user, you can upgrade whenever a release is made: "4.0.1", "4.0.2", "4.0.3", etc.. Each patch release will have a number of changes and fixes. These will probably come out ever week.
</li>
</ul>
<p>
Finally, all releases are considered stable. So, whenever a patch release comes out, it will be promoted to the official download for all new users. If it's safe enough for new users to try, it's definitely safe enough for existing users as well.
</p>
<h3>
<span class="mw-headline" id="(PC)_Fix_mass_parse_performance_issues_when_generating_English_Wikipedia">(PC) Fix mass parse performance issues when generating English Wikipedia</span>
</h3>
<p>
This was an issue I discovered when generating the 2016-12 English Wikipedia. It takes about 25 hours to dump English Wikipedia on an 8 core machine. Due to recent changes with Embeddable (using XOWA as a MediaWiki parser), this number grew to about 36 hours. In some cases, it even failed with OutOfMemory exceptions.
</p>
<p>
This build brings the build time back to 25 hours.
</p>
<h3>
<span class="mw-headline" id="Next_week:_v4.0.1.1701">Next week: v4.0.1.1701</span>
</h3>
<ul>
<li>
<b>Wikis</b>: I'm going to start preparing for the 2017-01 wikis. I'm on vacation for the 3rd and 4th weeks of 2016-01, so I'm going to focus on getting English Wikipedia and then move on to French and German
</li>
<li>
<b>Download Central and Android</b>: There were a number of issues brought up with Download Central and Android as described here: <a href="https://github.com/gnosygnu/xowa/issues/112" rel="nofollow" class="external free">https://github.com/gnosygnu/xowa/issues/112</a>
</li>
<li>
<b>Auto-update</b>: This involves an in-app auto-update features for XOWA as per <a href="https://github.com/gnosygnu/xowa/issues/110" rel="nofollow" class="external free">https://github.com/gnosygnu/xowa/issues/110</a>
</li>
<li>
<b>Other</b>: I'm looking at an old Math bug (<a href="https://github.com/gnosygnu/xowa/issues/10" rel="nofollow" class="external free">https://github.com/gnosygnu/xowa/issues/10</a> ), as well as Page sync changes (<a href="https://github.com/gnosygnu/xowa/issues/72" rel="nofollow" class="external free">https://github.com/gnosygnu/xowa/issues/72</a> ).
</li>
</ul>
<h2>
<span class="mw-headline" id="Release:_POSTPONED_(2017-01-03_01:30_Tue)">Release: POSTPONED (2017-01-03 01:30 Tue)</span>
</h2>
<p>
I was planning to do a release tonight, but ran into last-minute issues. I'm going to push for a release tomorrow or possibly next Sunday.
</p>
</div>
</div>
</div>
<div id="mw-head" class="noprint">
<div id="left-navigation">
<div id="p-namespaces" class="vectorTabs">
<h3>Namespaces</h3>
<ul>
<li id="ca-nstab-main" class="selected"><span><a id="ca-nstab-main-href" href="index.html">Page</a></span></li>
</ul>
</div>
</div>
</div>
<div id='mw-panel' class='noprint'>
<div id='p-logo'>
<a style="background-image: url(https://gnosygnu.github.io/xowa/xowa_logo.png);" href="http://xowa.org/" title="Visit the main page"></a>
</div>
<div class="portal" id='xowa-portal-home'>
<h3>XOWA</h3>
<div class="body">
<ul>
<li><a href="http://xowa.org/index.html" title='Visit the main page'>Main page</a></li>
<li><a href="http://xowa.org/screenshots.html" title='See screenshots of XOWA'>Screenshots</a></li>
<li><a href="https://www.youtube.com/watch?v=q0qbXYXEH6M" title="See a video of XOWA Desktop in action">Video</a></li>
<li><a href="http://xowa.org/home/wiki/Help/Download_XOWA.html" title='Download the XOWA application'>Download XOWA</a></li>
<li><a href="http://xowa.org/home/wiki/Dashboard/Image_databases.html" title='Download offline wikis and image databases'>Download wikis</a></li>
</ul>
</div>
</div>
<div class="portal" id='xowa-portal-started'>
<h3>Getting started</h3>
<div class="body">
<ul>
<li><a href="http://xowa.org/home/wiki/App/Setup/System_requirements.html" title='Get XOWA&apos;s system requirements'>Requirements</a></li>
<li><a href="http://xowa.org/home/wiki/App/Setup/Installation.html" title='Get instructions for installing XOWA'>Installation</a></li>
<li><a href="http://xowa.org/home/wiki/App/Import/Simple_Wikipedia.html" title='Learn how to set up Simple Wikipedia'>Simple Wikipedia</a></li>
<li><a href="http://xowa.org/home/wiki/App/Import/English_Wikipedia.html" title='Learn how to set up English Wikipedia'>English Wikipedia</a></li>
<li><a href="http://xowa.org/home/wiki/App/Import/Other_wikis.html" title='Learn how to set up other Wikipedias'>Other Wikipedias</a></li>
</ul>
</div>
</div>
<div class="portal" id='xowa-portal-android'>
<h3>Android</h3>
<div class="body">
<ul>
<li><a href="http://xowa.org/home/wiki/Android/Setup.html" title='Setup XOWA on your Android device'>Setup</a></li>
<li><a href="https://www.youtube.com/watch?v=jsMTBxGweUw" title="See a video of XOWA Android in action">Video</a></li>
</ul>
</div>
</div>
<div class="portal" id='xowa-portal-help'>
<h3>Help</h3>
<div class="body">
<ul>
<li><a href="http://xowa.org/home/wiki/Help/About.html" title='Get more information about XOWA'>About</a></li>
<li><a href="http://xowa.org/home/wiki/Help/Contents.html" title='View a list of help topics'>Contents</a></li>
<li><a href="http://xowa.org/home/wiki/Help/Media.html" title='Read what others have written about XOWA'>Media</a></li>
<li><a href="http://xowa.org/home/wiki/Help/Feedback.html" title='Questions? Comments? Leave feedback for XOWA'>Feedback</a></li>
</ul>
</div>
</div>
<div class="portal" id='xowa-portal-blog'>
<h3>Blog</h3>
<div class="body">
<ul>
<li><a href="http://xowa.org/home/wiki/Blog.html" title='Follow XOWA''s development process'>Current</a></li>
</ul>
</div>
</div>
<div class="portal" id='xowa-portal-links'>
<h3>Links</h3>
<div class="body">
<ul>
<li><a href="http://dumps.wikimedia.org/backup-index.html" title="Get wiki datababase dumps directly from Wikimedia">Wikimedia dumps</a></li>
<li><a href="https://archive.org/search.php?query=xowa" title="Search archive.org for XOWA files">XOWA @ archive.org</a></li>
<li><a href="http://en.wikipedia.org" title="Visit Wikipedia (and compare to XOWA!)">English Wikipedia</a></li>
</ul>
</div>
</div>
<div class="portal" id='xowa-portal-donate'>
<h3>Donate</h3>
<div class="body">
<ul>
<li><a href="https://archive.org/donate/index.php" title="Support archive.org!">archive.org</a></li><!-- listed first due to recent fire damages: http://blog.archive.org/2013/11/06/scanning-center-fire-please-help-rebuild/ -->
<li><a href="https://donate.wikimedia.org/wiki/Special:FundraiserRedirector" title="Support Wikipedia!">Wikipedia</a></li>
<li><a href="http://xowa.org/home/wiki/Help/Donate.html" title="Support XOWA!">XOWA</a></li>
</ul>
</div>
</div>
</div>
</body>
</html>