You can activate the edit feature for any page by clicking the Edit button in the top right-hand corner.
@@ -69,7 +69,7 @@
If you need to cancel changes you can simply click on either the Read or Edit button. As long as Save page is not invoked, the changes will not be saved.
- Wiki text and syntax
+ Wiki text and syntax[edit]
XOWA should support all forms of wiki syntax. Note that there may be outlier quirks due to discrepancies between XOWA's parsing approach and MediaWiki's.
@@ -78,7 +78,7 @@
If you need information on wiki syntax, you should consult the Wikipedia Wiki markup page.
- Corrections / fixes are encouraged
+ Corrections / fixes are encouraged[edit]
The Edit article feature should be used to correct articles that were broken or vandalized at the time of the data dump.
@@ -113,7 +113,7 @@
- Free-form edits are at your own risk
+ Free-form edits are at your own risk[edit]
Article editing should not be used for your own personal free-form edits. Note that each wiki dump is considered "disposable". The official source is the online Wikimedia version. Any changes made in to the offline version will be lost upon updating the dump.
@@ -122,19 +122,19 @@
For example, you can make extensive notes to the Earth page for your offline 2012-12-11 Simple Wikipedia data dump. Whenever you update to the data dump for 2013-01-11, you will need to manually copy and paste your edited page to the new wiki dump. XOWA has no provision for automatically carrying over any changes from the 2012-12-11 version to the 2013-01-11 one.
- Past versions are not archived
+ Past versions are not archived[edit]
XOWA currently does not archive edits. Once you save a page, the old version is lost. If you need to maintain history, you should either use the View History function on the online wikis, or manually track your own changes in a separate document.
Because past changes are not archived, there is a risk that you may accidentally overwrite changes while editing a page. It is encouraged that you test new changes in the sandbox for any given wiki. You can enter the sandbox by typing in Project:Sandbox in the Address bar, or by pressing Ctrl+F1.
If right-clicked, XOWA offers a "Save File As" to allow the user to save the file to another location.
@@ -128,7 +128,7 @@
Note that you can also click "View HTML" and get the file location directly from the HTML (in the appropriate <img>'s src value)
The cache periodically goes through the temporary files and deletes them once they reach a certain threshold (currently 100 MB).
@@ -159,7 +159,7 @@
- ImageMagick and Inkscape
+ ImageMagick and Inkscape[edit]
As of v2.5.4 ImageMagick and Inkscape are no longer needed for online image downloads.
@@ -179,7 +179,7 @@
- File databases: v1, v2a and v2b
+ File databases: v1, v2a and v2b[edit]
XOWA has 3 different types of database sets for English Wikipedia. These are named v1, v2a and v2b. All 3 sets work with the latest version of XOWA, but they have notable differences. See the table below for details.
diff --git a/home/wiki/App/Bookmarks.html b/home/wiki/App/Bookmarks.html
index eec38d891..77a2bcd5b 100644
--- a/home/wiki/App/Bookmarks.html
+++ b/home/wiki/App/Bookmarks.html
@@ -61,7 +61,7 @@
You can add a page to your bookmarks by using the menu bar or the right-click menu.
@@ -78,31 +78,31 @@
You will see a notification that starts with "bookmark added"
Bookmarks can be viewed and edited in HTTP server mode. This has been tested with Firefox (39), Chrome (43), Safari (8) and Internet Explorer (9). If you have an older version and it doesn't work, please report it to Help/Feedback
As of v2.7.3, XOWA now has a new Bookmarks page. All links will go to the new bookmarks page.
diff --git a/home/wiki/App/Category.html b/home/wiki/App/Category.html
index f7b2425ea..a551bbfc5 100644
--- a/home/wiki/App/Category.html
+++ b/home/wiki/App/Category.html
@@ -29,7 +29,7 @@
Version 1 is a simplistic category system.
@@ -104,7 +104,7 @@
However, because V1 is faster to setup than V2, it still remains the default (with a strong recommendation to upgrade to V2 when time permits)
Version 2 is an accurate category system.
diff --git a/home/wiki/App/Category/Building.html b/home/wiki/App/Category/Building.html
index 48ae108ba..aa7ff2964 100644
--- a/home/wiki/App/Category/Building.html
+++ b/home/wiki/App/Category/Building.html
@@ -18,7 +18,7 @@
For reference, this is the current script to set up the V2 Category system
@@ -77,7 +77,7 @@ app.bldr.run;
Note that 'ctg.hiddencat_sql' and 'ctg.hiddencat_ttl' can be omitted. However, it is recommended that they be run (for English Wikipedia, it adds less than 5 minutes to the entire process).
The main files are located at /xowa/wiki/simple.wikipedia.org/site/category2/main/. They follow the same hive structure as the other directories (a main reg.csv and subdirectories of the format of /00/00/00/00/0123456789.xdat)
@@ -232,7 +232,7 @@ B|p|Page_2_sortkey|!!!!^|!!!@@|
The link files are located at /xowa/wiki/simple.wikipedia.org/site/category2/link/. They also follow the same hive structure as the other directories.
diff --git a/home/wiki/App/Databases/Overview.html b/home/wiki/App/Databases/Overview.html
index 514acb9b3..bd7ed5144 100644
--- a/home/wiki/App/Databases/Overview.html
+++ b/home/wiki/App/Databases/Overview.html
@@ -44,7 +44,7 @@
XOWA uses one field: body.
@@ -310,7 +310,7 @@
In addition, XOWA uses three other fields: page_id, title, and page_score. These are included for system purposes only.
Lucene supports fuzzy searches based on the Levenshtein Distance, or Edit Distance algorithm. To do a fuzzy search use the tilde, "~", symbol at the end of a Single word Term. For example to search for a term similar in spelling to "roam" use the fuzzy search: roam~
@@ -341,7 +341,7 @@
The default that is used if the parameter is not given is 0.5.
Lucene supports finding words are a within a specific distance away. To do a proximity search use the tilde, "~", symbol at the end of a Phrase. For example to search for a "apache" and "jakarta" within 10 words of each other in a document use the search:
@@ -350,7 +350,7 @@
"jakarta apache"~10
Lucene provides the relevance level of matching documents based on the terms found. To boost a term use the caret, "^", symbol with a boost factor (a number) at the end of the term you are searching. The higher the boost factor, the more relevant the term will be.
@@ -377,13 +377,13 @@
By default, the boost factor is 1. Although the boost factor must be positive, it can be less than 1 (e.g. 0.2)
Boolean operators allow terms to be combined through logic operators. Lucene supports AND, "+", OR, NOT and "-" as Boolean operators(Note: Boolean operators must be ALL CAPS).
The OR operator is the default conjunction operator. This means that if there is no Boolean operator between two terms, the OR operator is used. The OR operator links two terms and finds a matching document if either of the terms exist in a document. This is equivalent to a union using sets. The symbol || can be used in place of the word OR.
@@ -404,7 +404,7 @@
The AND operator matches documents where both terms exist anywhere in the text of a single document. This is equivalent to an intersection using sets. The symbol && can be used in place of the word AND.
@@ -416,7 +416,7 @@
"jakarta apache" AND "Apache Lucene"
The "+" or required operator requires that the term after the "+" symbol exist somewhere in a the field of a single document.
@@ -428,7 +428,7 @@
+jakarta lucene
The NOT operator excludes documents that contain the term after NOT. This is equivalent to a difference using sets. The symbol ! can be used in place of the word NOT.
@@ -446,7 +446,7 @@
NOT "jakarta apache"
Lucene supports using parentheses to group clauses to form sub queries. This can be very useful if you want to control the boolean logic for a query.
@@ -473,7 +473,7 @@
This eliminates any confusion and makes sure you that website must exist and either term jakarta or apache may exist. Field Grouping
- Escaping Special Characters
+ Escaping Special Characters[edit]
Lucene supports escaping special characters that are part of the query syntax. The current list special characters are
diff --git a/home/wiki/App/Full-text_search/Lucene/Search_indexes/Building.html b/home/wiki/App/Full-text_search/Lucene/Search_indexes/Building.html
index 8f368a93a..7d12ebbb5 100644
--- a/home/wiki/App/Full-text_search/Lucene/Search_indexes/Building.html
+++ b/home/wiki/App/Full-text_search/Lucene/Search_indexes/Building.html
@@ -21,7 +21,7 @@
XOWA can generate full-text search indexes for existing Download Central wikis
Indexes can only be built for wikis downloaded from Download Central.
@@ -52,7 +52,7 @@
If your wiki isn't yet on Download Central, please contact me through Help/Feedback and I'll add your wiki to the queue.
Full-text search requires custom files in order to work.
@@ -50,7 +50,7 @@
Currently, there are two ways of getting these files
- Downloading from archive.org for 2017-03 English Wikipedia
+ Downloading from archive.org for 2017-03 English Wikipedia[edit]
For 2017-03 English Wikipedia, the search index must be downloaded manually from archive.org
@@ -67,7 +67,7 @@
- Downloading from Download Central for 2017-04 wikis and later
+ Downloading from Download Central for 2017-04 wikis and later[edit]
Full-text search indexes will be automatically part of any new wiki on Download Central uploaded on 2017-04 or later.
@@ -79,7 +79,7 @@
If your wiki isn't yet on Download Central, please contact me through Help/Feedback and I'll add your wiki to the queue.
- Building indexes for already-existing Download Central wikis
+ Building indexes for already-existing Download Central wikis[edit]
Full-text search indexes can also be generated within application. For more information, see App/Full-text_search/Lucene/Search_indexes/Building
diff --git a/home/wiki/App/Import/Download/Aria2.html b/home/wiki/App/Import/Download/Aria2.html
index a377de6f2..06e03f3e5 100644
--- a/home/wiki/App/Import/Download/Aria2.html
+++ b/home/wiki/App/Import/Download/Aria2.html
@@ -21,7 +21,7 @@
aria2 is an open-source application to simplify downloading files.
your.org is the default dump server. This mirror happens to be significantly faster than the official Wikimedia dump server. There was also a recent post on xmldatadumps-l that requested mirror server usage over the official ones: http://lists.wikimedia.org/pipermail/xmldatadumps-l/2012-December/000644.html
- Changing the dump server
+ Changing the dump server[edit]
Please see Options/Import
diff --git a/home/wiki/App/Import/Download_Central.html b/home/wiki/App/Import/Download_Central.html
index 7fe4986e3..55ab44d75 100644
--- a/home/wiki/App/Import/Download_Central.html
+++ b/home/wiki/App/Import/Download_Central.html
@@ -78,7 +78,7 @@
As of v3.6.3, the Download Central page lists available wikis for download.
@@ -104,7 +104,7 @@
More wikis and functionality will be added to this page throughout 2016.
Some users may not want to use Download Central. For example, users may have an alternate download manager which will be faster[1]
@@ -209,13 +209,13 @@
- Existing monthly update users of the English Wikipedia v2b images
+ Existing monthly update users of the English Wikipedia v2b images[edit]
This section only applies to users who have been manually downloading the monthly updates for English Wikipedia.
- No need to redownload the images in Download Central
+ No need to redownload the images in Download Central[edit]
The Download Central image databases are the same as the existing ones on archive.org. They only differ in the following ways:
@@ -304,7 +304,7 @@
At this point you will have exactly the same files as those in Download Central
- Download Central should be used for 2016-07 and future monthly updates
+ Download Central should be used for 2016-07 and future monthly updates[edit]
For next month (and future months), you should download the monthly update through Download Central. There will be a new task called "English Wikipedia - Image Update (2016-07)". You will just need to download this item, and you'll be up-to-date.
@@ -313,7 +313,7 @@
Of course, you will still be able to download them manually from archive.org. But as shown by the section above, this can be quite laborious.
English Wikipedia has a lot of data. There are over 16 million pages with 25 GB of text, as well as 5 million images.
@@ -64,10 +64,10 @@
Although the process itself is not hard, I strongly recommend that you try Simple Wikipedia first. Simple Wikipedia has 180,000 pages and 90,000 images. The text version uses 200 MB and sets up in 5 minutes. With images, this expands to 2 GB and 30 minutes of downloading time. Simple Wikipedia is a reasonably accurate simulation of English Wikipedia -- just much smaller. It'll also give you a pretty good idea of what XOWA can do.
diff --git a/home/wiki/App/Import/Image_databases/Pruning.html b/home/wiki/App/Import/Image_databases/Pruning.html
index 73ffbd68d..0265e59e3 100644
--- a/home/wiki/App/Import/Image_databases/Pruning.html
+++ b/home/wiki/App/Import/Image_databases/Pruning.html
@@ -21,7 +21,7 @@
XOWA's image databases will accumulate old images and take up unnecessary disk space. This page outlines the process to prune these old images
XOWA releases monthly updates of English Wikipedia images. However, every month, English Wikipedia removes many old images. Over time, the removed images will cause XOWA's image databases to grow larger than necessary.
@@ -33,13 +33,13 @@
If you want to reduce your image database size for English Wikipedia, you can try either of the two options below.
- Option 1: Download the updated set
+ Option 1: Download the updated set[edit]
The simplest approach is to download the latest set. Note that this will require downloading approximately 62 GB of compressed data. Users who have bandwidth issues (caps / low connectivity) may want to look at the next option.
- Option 2: Prune the images manually
+ Option 2: Prune the images manually[edit]
Note the following:
diff --git a/home/wiki/App/Import/Import_overview.html b/home/wiki/App/Import/Import_overview.html
index 3a3c85c5b..fa09bc409 100644
--- a/home/wiki/App/Import/Import_overview.html
+++ b/home/wiki/App/Import/Import_overview.html
@@ -42,7 +42,7 @@
- Import HTML dumps from archive.org
+ Import HTML dumps from archive.org[edit]
- Import online by click
+ Import online by click[edit]
The Import online page lists 800+ wikis that can be imported by clicking on a link.
@@ -79,7 +79,7 @@
- Import offline by script
+ Import offline by script[edit]
The Import offline page can generate a script that will import a wiki.
@@ -90,7 +90,7 @@
- Import by command-line
+ Import by command-line[edit]
The Dev/Command-line page offers instructions on importing through the command-line.
diff --git a/home/wiki/App/Import/Manual.html b/home/wiki/App/Import/Manual.html
index 9933a6b05..c8e20d495 100644
--- a/home/wiki/App/Import/Manual.html
+++ b/home/wiki/App/Import/Manual.html
@@ -18,7 +18,7 @@
- Reasons for manual import
+ Reasons for manual import[edit]
The list of data dumps allows you to download dumps for any wiki with one mouse click. However, there are times when you want to manually import a wiki:
@@ -41,7 +41,7 @@
There are currently two ways to do a manual import
@@ -67,7 +67,7 @@
- Manual import using the xowa_command
+ Manual import using the xowa_command[edit]
To do a manual import using the xowa_command, do the following
diff --git a/home/wiki/App/Import/Offline.html b/home/wiki/App/Import/Offline.html
index 038850410..0f8192eb0 100644
--- a/home/wiki/App/Import/Offline.html
+++ b/home/wiki/App/Import/Offline.html
@@ -21,7 +21,7 @@
If you've downloaded a dump already, you can import the .bz2 file into XOWA.
Other Wikipedias will follow the same process as setting up Simple Wikipedia or English Wikipedia. The steps are summarized below, but you should read both Help:Set up Simple Wikipedia and Help:Set up English Wikipedia
@@ -48,7 +48,7 @@
Note that some Wikipedias will require a lot of disk space. For example, German Wikipeda requires at least 40 GB. Depending on your location it may take several hours to download that much data. Please prepare accordingly.
- Part 1: Set up the wiki
+ Part 1: Set up the wiki[edit]
The first part is to set up the wiki. The set-up process involves the following steps:
@@ -85,7 +85,7 @@
The import process will start. When it's done, it will automatically load the Main Page.
- Part 2: Download the images
+ Part 2: Download the images[edit]
This part usually takes much longer to complete. It will require many GB of disk space and many hours of download time. For example, German Wikipedia takes up 32 GB and may take 16 hours to download.
@@ -120,7 +120,7 @@
If you want to update your wiki, you won't have to repeat the whole process.
diff --git a/home/wiki/App/Import/Removal.html b/home/wiki/App/Import/Removal.html
index b8154c7f4..fb8f67f16 100644
--- a/home/wiki/App/Import/Removal.html
+++ b/home/wiki/App/Import/Removal.html
@@ -32,7 +32,7 @@
Wikis can be removed by deleting specific folders on the file system.
diff --git a/home/wiki/App/Import/Shrinking.html b/home/wiki/App/Import/Shrinking.html
index 87af1828c..37b9a4e87 100644
--- a/home/wiki/App/Import/Shrinking.html
+++ b/home/wiki/App/Import/Shrinking.html
@@ -21,7 +21,7 @@
This article explains how to reduce disk space for a wiki. It will focus on English Wikipedia, but the same steps apply to any other wiki.
The main BZ2 file takes 9 GB. This BZ2 file is located wherever you downloaded it.
@@ -33,7 +33,7 @@
If you are using the automated set up from Dashboard/Import/Online, the BZ2 file is moved to /xowa/wiki/#done. XOWA does not delete this file in case the user wants to re-import the wiki, and avoid redownloading the entire file.
You can prune entire namespaces. For example, some users may not be interested in the Wikipedia namespace as it contains mostly meta-information about Wikipedia. The namespace itself is about 3.0 GB.
diff --git a/home/wiki/App/Import/Simple_Wikipedia.html b/home/wiki/App/Import/Simple_Wikipedia.html
index d3c72ec41..7f9eb289f 100644
--- a/home/wiki/App/Import/Simple_Wikipedia.html
+++ b/home/wiki/App/Import/Simple_Wikipedia.html
@@ -53,13 +53,13 @@
Simple Wikipedia is a smaller wiki with 180,000+ pages and 90,000+ images. The text version can be setup in less than 5 minutes, using only 200 MB of disk space. The images version is a little larger: it needs 30 minutes of download time and 2 GB of space.
- Part 1: Import the wiki
+ Part 1: Import the wiki[edit]
@@ -76,7 +76,7 @@
- Part 2: Download all the images for offline viewing
+ Part 2: Download all the images for offline viewing[edit]
XOWA is an offline wiki application for online wikis. It works by converting a MediaWiki XML dump into an .xowa sqlite3 database.
@@ -104,7 +104,7 @@
An alternative to this process is to use Mattze96's mwad: the Media Wiki Api dump
Personal wikis are user-created standalone wikis. They are not imported from any existing online wikis, but created and edited entirely within XOWA. For anyone who has ever edited a Wikipedia page, creating a personal wiki should be a familiar and easy process.
XOWA stores all the data for a personal wiki in a single .xowa file. This .xowa file is a sqlite3 file, but has the extension renamed to .xowa. You can use any sqlite program to browse a .xowa file. You can either use the official sqlite command-line shell (https://sqlite.org/download.html ), or a gui-capable program (http://sqlitebrowser.org)
@@ -57,13 +57,13 @@
All your wiki data is stored in the .xowa file. You can email the file, upload it to a file service, or just copy it from one machine to the next.
XOWA is as an offline Wikipedia app. It was meant for usage in a disconnected enviornment. It does not collect data to send elsewhere. For full details on privacy, see Help/Privacy/Desktop
Personal wikis are still a work-in-progress. Although I've been using personal wikis for the XOWA home wiki for over three years, it has not been used by anyone else until 2017-02.
@@ -91,7 +91,7 @@
Table of contents (TOC) are automatically generated by XOWA if you have 4 headers (a header being something like == header ==)
@@ -812,13 +812,13 @@ para 2
If you have less than 4 headers, you can force a TOC by adding __TOC__
Wikipedia-style references are supported. For example, this is a simple reference: [1].
@@ -827,7 +827,7 @@ para 2
Note that you can hover over the reference number to get a tooltip preview
Modules are supported, such as {{#invoke:my_module|my_function|arg_1|arg_2|etc...}}. For more info, see https://en.wikipedia.org/wiki/Wikipedia:Lua
@@ -979,7 +979,7 @@ return p
XOWA stores the CSS for each wiki in /xowa/user/anonymous/wiki/your_wiki_name/html. For example, if you're on Windows and your wiki is named test, then the CSS would be at C:\xowa\user\anonymous\wiki\test\html\xowa_common.css
@@ -1008,7 +1008,7 @@ return p
You can change these files and XOWA will not overwrite them. However, as with any file, please make sure you always keep backups.
XOWA stores the page template in /xowa/bin/any/xowa/cfg/app/xowa.gfs. The actual template is marked in a section called page_read.
@@ -1033,13 +1033,13 @@ return p
The domain name is a unique id to your wiki within the XOWA app. As reference, English Wikipedia has a domain name of en.wikipedia.org.
@@ -81,7 +81,7 @@
The name is a freeform text name used to identify your wiki. Currently, it's only being used on Special:XowaWikiDirectory, but it will be used more elsewhere.
@@ -90,7 +90,7 @@
The name only has a limitation of 255 characters or less.
The folder is where your wiki is located. XOWA saves all data in one .xowa file[2], but it needs to assign a folder to a wiki to generate other temporary data.
@@ -131,7 +131,7 @@
XOWA has a search feature based on page title. It is used for the following:
@@ -35,7 +35,7 @@
The search feature is based off of the PageRank algorithm. Because of the complicated, recursive nature of the algorithm, the index can only be run for the entire wiki at once -- not every time a page changes. For small wikis, search reindexing will complete in a few seconds. For a large wiki like en.wikipedia.org, it could take 12 hours.
- Search by page title
+ Search by page title[edit]
XOWA can find a page by words in its title. For example, typing earth will pull up all titles with the word, including Earth and History of Earth. More complicated searches can be performed, such as earth + (history, future) -middle
@@ -124,7 +124,7 @@
XOWA can also search by text within a page (full-text search). More information is available here: App/Full-text search
By default, XOWA returns results sorted by "page length descending". In other words, the largest page would be the first in the list and the smallest page would be the last.
@@ -562,7 +562,7 @@
If a wiki is built with PageRank, or if a wiki is downloaded from archive.org, then the results will be sorted by "PageRank descending". See Options/Search for enabling PageRank.
By default, XOWA runs database searches in the background. This will return results to the screen quickly for complicated searches. For example, consider a search for Earth*:
@@ -582,7 +582,7 @@
Finally, all search results are cached. The first time you search for Earth*, XOWA will search the database. Every time afterwards, it will pull the results up from memory. If you restart XOWA, it will search the database again.
XOWA wikis created before v3.3.4.1 will need to be upgraded. XOWA will detect if an upgrade is needed, and show a message box for confirmation. The upgrade process will take a few minutes.
@@ -591,7 +591,7 @@
Note that new wikis created after v3.3.4.1 will automatically be in the new format.
As of v3.3.4.1, the address bar supports auto-completion. This function can only be used with a wiki built in v3.3.4.1 or later. If the address bar is not working, you should rebuild the search-databases. See App/Search/Build for more information.
As of v3.3.4.1, XOWA has a new search engine. This uses the same search functionality that is in XOWA Android.
diff --git a/home/wiki/App/Search/Score.html b/home/wiki/App/Search/Score.html
index 90c932635..9b20b57de 100644
--- a/home/wiki/App/Search/Score.html
+++ b/home/wiki/App/Search/Score.html
@@ -58,7 +58,7 @@
A simplified definition of scaling is converting a number from one range to another range based on proportion. For a more thorough definition, see the Wikipedia page on feature scaling
@@ -120,7 +120,7 @@ newScore = \frac{oldScore - \text{min}(oldRange)} {\text{max}(oldRange)-\text{mi
A simplified definition of ranking is assigning a number based on its order in a population of numbers. For those familiar with a school setting, this is "grading on a curve". For a more thorough definition, see the Wikipedia page on percentile ranks
@@ -213,10 +213,10 @@ newScore = \frac{oldScore - \text{min}(oldRange)} {\text{max}(oldRange)-\text{mi
The basis of XOWA's page score is PageRank.
@@ -239,7 +239,7 @@ newScore = \frac{oldScore - \text{min}(oldRange)} {\text{max}(oldRange)-\text{mi
After XOWA calculates the PageRank, XOWA then scales this score in a range of 0 to 1,000,000
- Short pages are penalized
+ Short pages are penalized[edit]
XOWA penalizes short pages. This reduces the effect of small stub pages which are linked to by many articles, but mostly from boilerplate navigation boxes.
@@ -265,7 +265,7 @@ newScore = \frac{oldScore - \text{min}(oldRange)} {\text{max}(oldRange)-\text{mi
Note that this calculation is an ad-hoc creation and will probably change in the future.
- Scores are re-scaled
+ Scores are re-scaled[edit]
The final step is to take the modified score and rank it from 0 to 1,000,000. Note that this final score is an integer (not a decimal / float)
diff --git a/home/wiki/App/Search/Special_page.html b/home/wiki/App/Search/Special_page.html
index bb3c63179..2e6a51902 100644
--- a/home/wiki/App/Search/Special_page.html
+++ b/home/wiki/App/Search/Special_page.html
@@ -18,7 +18,7 @@
If you enter a search string and press Enter, a list of pages beginning with the search term will appear.
@@ -36,7 +36,7 @@
Note that sorting is done using binary collation. This means that the following titles will sort in this order "AA AB AC Aa Bb Ac", not "AA Aa AB Ab AC Ac". This matches Wikipedia's current sorting behavior.
Currently, XOWA has not implemented the UI for dynamically changing the following:
@@ -93,7 +93,7 @@ app.gui.win_opts.search_box_fmt_('Special:AllPages?from=~{search}&namespace=
If you want to hide redirects by default, you can change this to hideredirects=1. Please see Dev/Config_files files/Files for information about where to make this change.
As mentioned above, XOWA will add a basic UI for configuring from, namespace and hideredirects.
diff --git a/home/wiki/App/Setup/Flash_card.html b/home/wiki/App/Setup/Flash_card.html
index 3859ca9b2..bc9e60ed1 100644
--- a/home/wiki/App/Setup/Flash_card.html
+++ b/home/wiki/App/Setup/Flash_card.html
@@ -50,13 +50,13 @@
XOWA can use a standalone JRE for Windows machines. This allows zero-install launches of XOWA from an flash-memory card on any Windows machine - regardless of whether or not Java is installed.
XOWA can be set up to run with a portable JVM from portableapps.com. See: http://portableapps.com/apps/utilities/java_portable
diff --git a/home/wiki/App/Setup/Installation.html b/home/wiki/App/Setup/Installation.html
index c93893179..dbe715cf6 100644
--- a/home/wiki/App/Setup/Installation.html
+++ b/home/wiki/App/Setup/Installation.html
@@ -36,7 +36,7 @@
- Download and unzip XOWA
+ Download and unzip XOWA[edit]
XOWA works from one folder. For the purpose of the instructions throughout this wiki, this folder will be referred to as /xowa/.
diff --git a/home/wiki/App/Setup/Installation/Notes.html b/home/wiki/App/Setup/Installation/Notes.html
index 928227ec1..07fbe9ee2 100644
--- a/home/wiki/App/Setup/Installation/Notes.html
+++ b/home/wiki/App/Setup/Installation/Notes.html
@@ -18,7 +18,7 @@
- Operating System dependent files
+ Operating System dependent files[edit]
The following two files are operating-system dependent files:
@@ -35,7 +35,7 @@
XUL Runner is included in the xowa_app_packages. However, if you need to download it separately, please do the following:
diff --git a/home/wiki/App/Setup/System_requirements.html b/home/wiki/App/Setup/System_requirements.html
index 6bc7f567e..05821d256 100644
--- a/home/wiki/App/Setup/System_requirements.html
+++ b/home/wiki/App/Setup/System_requirements.html
@@ -47,7 +47,7 @@
XOWA will check for updates every time the application starts. It does this in a two-step process:
@@ -164,7 +164,7 @@
If any updates are available, it will open the Special:XowaUpdate page
- Upgrade shelf-life of 4 weeks
+ Upgrade shelf-life of 4 weeks[edit]
A given upgrade will only work if your release is within the past 4 weeks. For example:
@@ -165,13 +165,13 @@
- Upgrade issues should fallback to xowa_app packages
+ Upgrade issues should fallback to xowa_app packages[edit]
If you have problems after using an xowa_upgrade package, try upgrading using an xowa_app package. I personally test xowa_app packages on both Windows and Linux for every release and these will always work. In addition, due to the nature of the build script, the application package is always guaranteed to have the latest changes.
- Upgrade by an xowa_app package
+ Upgrade by an xowa_app package[edit]
You can also upgrade by downloading an xowa_app package and unzipping everything in the xowa root directory. For example:
@@ -194,7 +194,7 @@
Note that you can always just upgrade using the xowa_app package. The xowa_upgrade packages are provided because they are generally 5 to 10 times smaller than the application packages.
- Upgrade by an xowa_app package and regenerating the XOWA root directory
+ Upgrade by an xowa_app package and regenerating the XOWA root directory[edit]
You can also do an upgrade by renaming your existing XOWA root directory and unzipping a new app package in the same directory. For example, assuming a Windows system with XOWA in C:\xowa
@@ -225,7 +225,7 @@
This approach is more manual, but is meant as an alternate approach. It's also useful for moving XOWA from one drive to another.
XOWA also has an in-app updater. See the in-app help page
diff --git a/home/wiki/App/Setup/Upgrading.html b/home/wiki/App/Setup/Upgrading.html
index 7680ffa81..01bba7108 100644
--- a/home/wiki/App/Setup/Upgrading.html
+++ b/home/wiki/App/Setup/Upgrading.html
@@ -56,7 +56,7 @@
- Upgrade shelf-life of 4 weeks
+ Upgrade shelf-life of 4 weeks[edit]
A given upgrade will only work if your release is within the past 4 weeks. For example:
@@ -165,13 +165,13 @@
- Upgrade issues should fallback to xowa_app packages
+ Upgrade issues should fallback to xowa_app packages[edit]
If you have problems after using an xowa_upgrade package, try upgrading using an xowa_app package. I personally test xowa_app packages on both Windows and Linux for every release and these will always work. In addition, due to the nature of the build script, the application package is always guaranteed to have the latest changes.
- Upgrade by an xowa_app package
+ Upgrade by an xowa_app package[edit]
You can also upgrade by downloading an xowa_app package and unzipping everything in the xowa root directory. For example:
@@ -194,7 +194,7 @@
Note that you can always just upgrade using the xowa_app package. The xowa_upgrade packages are provided because they are generally 5 to 10 times smaller than the application packages.
- Upgrade by an xowa_app package and regenerating the XOWA root directory
+ Upgrade by an xowa_app package and regenerating the XOWA root directory[edit]
You can also do an upgrade by renaming your existing XOWA root directory and unzipping a new app package in the same directory. For example, assuming a Windows system with XOWA in C:\xowa
@@ -225,7 +225,7 @@
This approach is more manual, but is meant as an alternate approach. It's also useful for moving XOWA from one drive to another.
XOWA also has an in-app updater. See the in-app help page
diff --git a/home/wiki/App/UI/Address_bar/Shortcuts.html b/home/wiki/App/UI/Address_bar/Shortcuts.html
index 47d2ee572..6d0e1cab3 100644
--- a/home/wiki/App/UI/Address_bar/Shortcuts.html
+++ b/home/wiki/App/UI/Address_bar/Shortcuts.html
@@ -39,7 +39,7 @@
- Shortcuts to wikis in the current language
+ Shortcuts to wikis in the current language[edit]
XOWA has pre-defined shortcuts to different wikis. These allow quick access to an article in another wiki without entering in the full url.
@@ -191,7 +191,7 @@
- Shortcuts to wikis in another language
+ Shortcuts to wikis in another language[edit]
Wikis in a non-English language can be opened by prefixing the language code to the shortcut.
@@ -206,7 +206,7 @@
Note that fr is the language code for "French" and w is the XOWA type code for "Wikipedia" as defined above.
A full URL will point absolutely to one specific page in one specific wiki from any wiki.
@@ -51,7 +51,7 @@
For example, "en.wikipedia.org/wiki/Earth" will always navigate to the "Earth" page in "en.wikipedia.org" regardless of whether the current wiki is "en.wikipedia.org", "en.wiktionary.org" or "simple.wikipedia.org"
A short name allows quick lookup of an article within the current wiki.
@@ -60,7 +60,7 @@
For example, if you are in "en.wikipedia.org", typing in just "Earth" will take you to the Earth page inside en.wikipedia.org.
A shortcut is a compromise between the absolute reference of a full URL and the brevity of a page name.
@@ -72,7 +72,7 @@
See shortcuts for more information.
An http format url allows for copying and pasting directly from Firefox or other applications.
diff --git a/home/wiki/App/UI/Find_box.html b/home/wiki/App/UI/Find_box.html
index d1474ffce..c518009da 100644
--- a/home/wiki/App/UI/Find_box.html
+++ b/home/wiki/App/UI/Find_box.html
@@ -36,7 +36,7 @@
The Find box is intended to work like the Mozilla Firefox Find box. To use it, please do the following
@@ -56,7 +56,7 @@
You can try it out on this page with the word "find". Try it out.
Note that in Read mode, the Find box will find any word on the page. This includes sections outside the main content area, such as the left nav. Type the word "page" and see what gets found.
@@ -65,7 +65,7 @@
However in Edit and View HTML mode, the find functionality is limited to text in the main text box.
XOWA uses SWT for its Web Browser across all 3 major operating systems: Windows, Linux, Mac OS X.
@@ -110,10 +110,10 @@ app.gui {
More information on the 3 modes are below
XULRunner is a runtime package provided by Mozilla that can be used to build Firefox-like applications. It can be deployed in a standalone package that does not interfere with any installed versions of Firefox.
@@ -134,7 +134,7 @@ app.gui {
}
Mozilla Firefox has Extended Support Releases (ESRs). These start at version 10 and occur at 7-step intervals: 10, 17, 24, 31, 38.
@@ -143,7 +143,7 @@ app.gui {
Each version of SWT limits compatibility to a specific XULRunner ESR. For SWT version 4.5, the highest XULRunner is 31. Also, non-ESR versions are not allowed. For example, SWT will fail if using XULRunner v30.
SWT can also be configured to use the system's default WebKit browser. In most cases, this relates directly to Safari and is easiest done on a Mac OS X system. It can be done for Linux / Windows, but further steps need to be taken. See https://www.eclipse.org/swt/faq.php#howusewebkit
@@ -176,7 +176,7 @@ app.gui {
Note this may not work on systems with proper webkit support.
SWT can also be configured to use the system's browser through the keyword "none". For all intents and purposes, this basically applies to using Internet Explorer on Windows machines.
@@ -185,10 +185,10 @@ app.gui {
XOWA does not support Internet Explorer. It may do so in the future, but it would be dependent on the ease of the Javascript / CSS integration.
- Current state of the SWT HTML Browser by operating systems
+ Current state of the SWT HTML Browser by operating systems[edit]
As of v2.6.5, XOWA uses XUL Runner 24 for both Windows 32 bit and Windows 64.
@@ -206,7 +206,7 @@ app.gui {
Neither WebKit nor None are supported on Windows.
XOWA allows keyboard navigation using the content-editable attribute. Note that this is somewhat of a hack and it results in odd UI behavior.
@@ -59,13 +59,13 @@
To add a group, add a new section for add_grp
diff --git a/home/wiki/App/UI/Night_mode.html b/home/wiki/App/UI/Night_mode.html
index f944f3088..cf43b1cb7 100644
--- a/home/wiki/App/UI/Night_mode.html
+++ b/home/wiki/App/UI/Night_mode.html
@@ -64,7 +64,7 @@
Colors for the following must be changed at the Operating System level:
@@ -107,7 +107,7 @@
Note that these can not be changed within XOWA, as the underlying UI framework library (SWT) does not allow it.
Colors for the following are controlled by SWT:
@@ -133,7 +133,7 @@
By default, a simple white on black theme is chosen. Exact colors can be chosen through Special:XowaCfg?grp=xowa.gui.nightmode.
Colors for all HTML content are specified through the CSS. By default, XOWA uses a global css at C:\xowa\bin\any\xowa\html\css\nightmode\xowa_night.css.
@@ -171,16 +171,16 @@
If you want to customize the CSS, it must be done per wiki. Place the modified css file at C:\xowa\user\anonymous\wiki\your_wiki_name\html\xowa_night.css
- White border around tab buttons
+ White border around tab buttons[edit]
The tab buttons have white borders. Unfortunately these are specified thru SWT and cannot be changed.
- Flashing white background when viewing new pages
+ Flashing white background when viewing new pages[edit]
The HTML browser can sometimes flash white when viewing new pages. This seems to be an issue with the SWT browser control. It can be mitigated through the following
@@ -197,13 +197,13 @@
Note that this option is not changed automatically because it has a minor privacy implication (pages are saved temporarily to the disk instead of being set directly through memory)
- Flashing white background when opening new tabs
+ Flashing white background when opening new tabs[edit]
The HTML browswer can still flash sometimes when opening new tabs (Ctrl+T). This is an issue with the SWT tab control. Unfortunately, this cannot be changed
- Various icons are hard to see in night mode
+ Various icons are hard to see in night mode[edit]
For example, the save button on the New Personal Wikis screen is a black floppy disk. This is hard to distinguish against a black background.
diff --git a/home/wiki/App/UI/Printing.html b/home/wiki/App/UI/Printing.html
index bcad7c8a3..befdc8feb 100644
--- a/home/wiki/App/UI/Printing.html
+++ b/home/wiki/App/UI/Printing.html
@@ -39,7 +39,7 @@
XOWA currently does not support printing by default. This limitation is due to an underlying bug in the SWT HTML browser: https://bugs.eclipse.org/bugs/show_bug.cgi?id=376358
- Printing after saving to a file
+ Printing after saving to a file[edit]
The simplest way to print a document is to do the following:
@@ -62,7 +62,7 @@
- Printing directly from XOWA
+ Printing directly from XOWA[edit]
If you want to print directly from XOWA, you will need to do extra configuration.
diff --git a/home/wiki/App/UI/Tabs.html b/home/wiki/App/UI/Tabs.html
index 49f61fae1..18d2b31f0 100644
--- a/home/wiki/App/UI/Tabs.html
+++ b/home/wiki/App/UI/Tabs.html
@@ -21,7 +21,7 @@
As of v1.5.1, XOWA provides a tab interface.
If you click on an image in Wikipedia, it will try to open up its File page. Most File pages reside in Commons. Without the Commons wiki, you will not get more metadata on the image, nor will you be able to download the full size version
@@ -30,7 +30,7 @@
Note that Wikipedia may display images under an "en.wikipedia.org" url, but it has actually retrieved the data from commons.wikimedia.org.
If you click on the main image on its File Page, it will download the original size image and open it in your image viewer. For example, clicking on the image at http://commons.wikimedia.org/wiki/File:Mona_Lisa,_by_Leonardo_da_Vinci,_from_C2RMF_retouched.jpg will download and open the full 7,479 × 11,146 image (89.9 MB).
diff --git a/home/wiki/App/Wiki_types/Data_dumps.html b/home/wiki/App/Wiki_types/Data_dumps.html
index e5eccadb4..bc2f2fb8b 100644
--- a/home/wiki/App/Wiki_types/Data_dumps.html
+++ b/home/wiki/App/Wiki_types/Data_dumps.html
@@ -29,7 +29,7 @@
To clean up the images, do the following:
diff --git a/home/wiki/App/Wiki_types/Wikidata.html b/home/wiki/App/Wiki_types/Wikidata.html
index 7ac414e86..840c710bb 100644
--- a/home/wiki/App/Wiki_types/Wikidata.html
+++ b/home/wiki/App/Wiki_types/Wikidata.html
@@ -27,7 +27,7 @@
This page has a brief explanation of wikidata in relation to XOWA.
Phase 1 began in February of 2013. It involved moving all language links from an individual page to Wikidata.
@@ -42,7 +42,7 @@
As of v0.3.2 (2013-03-25) XOWA now emulates that process, but requires that www.wikidata.org be downloaded.
Phase 2 is scheduled to start at the end of March 2013. It involves moving infoboxes data to Wikidata
@@ -51,7 +51,7 @@
XOWA currently supports basic features of Phase 2 -- namely the {{#property}}.
As of v0.12.1, XOWA now includes an HTTP server in addition to a TCP server. The TCP server is used by the Firefox Add-On (See App/Xtn/Browser/XOWA_viewer).
@@ -36,10 +36,10 @@
Note that the HTTP server is currently in an alpha stage, but should improve with coming releases. If you have any comments or feedback, please see https://sourceforge.net/p/xowa/discussion/general/thread/fa4baf84/
diff --git a/home/wiki/App/Xtn/Browser/TCP_Server.html b/home/wiki/App/Xtn/Browser/TCP_Server.html
index 957ef3fd1..7d299be82 100644
--- a/home/wiki/App/Xtn/Browser/TCP_Server.html
+++ b/home/wiki/App/Xtn/Browser/TCP_Server.html
@@ -24,7 +24,7 @@
Note that XOWA uses two ports for communications: an inbound port (defaults to 55000) and an outbound port (defaults to 55001). This may change in later implementations.
There are four arguments related to the console app
diff --git a/home/wiki/App/Xtn/Browser/XOWA_viewer.html b/home/wiki/App/Xtn/Browser/XOWA_viewer.html
index 134188478..76ed3f407 100644
--- a/home/wiki/App/Xtn/Browser/XOWA_viewer.html
+++ b/home/wiki/App/Xtn/Browser/XOWA_viewer.html
@@ -59,16 +59,16 @@
As of Firefox version 43, unsigned addons are no longer supported. See https://support.mozilla.org/en-US/kb/add-on-signing-in-firefox The XOWA Firefox Addon should be signed in the future, but in the meantime, you can use the open-source alternative Pale Moon as a substitute:
@@ -88,7 +88,7 @@
The Add-on installs an XOWA toolbar button called "XOWA Home". Users can enable it by doing the following:
@@ -119,7 +119,7 @@
- Features and Limitations
+ Features and Limitations[edit]
The XOWA viewer is a work in progress. XOWA needs to make changes to communicate with Firefox over TCP (right now it communicates directly with the embedded browser)
@@ -184,7 +184,7 @@
The source code is available under the Mozilla Public License at gitub.
@@ -221,7 +221,7 @@
It is also contained in the Addon itself. You can unzip the .xpi and examine any of the underlying files. The code is in javascript and there are no binary dependencies.
XOWA Popups is based on MediaWiki's Hovercards and Navigation popups. It does not aim to be an exact reproduction of either, but picks the best features from each.
@@ -128,7 +128,7 @@
XOWA Popups uses a modified version of the XOWA parser. The popup parser has the following attributes:
diff --git a/home/wiki/App/Xtn/Html/Scripts.html b/home/wiki/App/Xtn/Html/Scripts.html
index e2166e084..e09b0871a 100644
--- a/home/wiki/App/Xtn/Html/Scripts.html
+++ b/home/wiki/App/Xtn/Html/Scripts.html
@@ -18,13 +18,13 @@
By default, anything that matches a rule (has a score > 0) will be excluded. Note that this exclude number can be raised from 0 to something higher like 100. See Options/Import_Dansguardian
The import filter can also be used to build content-specific wikis. For example, let's say you wanted to build a wiki that only includes articles with the words "planet" and "earth planet". The following can be done:
@@ -241,7 +241,7 @@
The filter process also provides a way to list articles that will always be included / excluded, regardless of rule score.
@@ -260,10 +260,10 @@ Sun
Similarly, to manually include an article, save the file to /xowa/bin/any/xowa/cfg/bldr/filter/wiki_name/xowa.title.include.txt
diff --git a/home/wiki/App/Xtn/Mediawiki/Math/Latex/Windows.html b/home/wiki/App/Xtn/Mediawiki/Math/Latex/Windows.html
index 28583b4a4..f6d06b6c4 100644
--- a/home/wiki/App/Xtn/Mediawiki/Math/Latex/Windows.html
+++ b/home/wiki/App/Xtn/Mediawiki/Math/Latex/Windows.html
@@ -21,7 +21,7 @@
LaTEX is not natively available to Windows. Fortunately, MiKTEX is open-source and distributed under Free Software Guidelines.
Wait a few seconds. You will get a MikTeX prompt to download another repository. Specifically:
diff --git a/home/wiki/App/Xtn/Mediawiki/Math/MathJax.html b/home/wiki/App/Xtn/Mediawiki/Math/MathJax.html
index 781904bda..3591356ac 100644
--- a/home/wiki/App/Xtn/Mediawiki/Math/MathJax.html
+++ b/home/wiki/App/Xtn/Mediawiki/Math/MathJax.html
@@ -18,13 +18,13 @@
The following is a list of setup notes for MathJax:
diff --git a/home/wiki/App/Xtn/Mediawiki/Math/Setup.html b/home/wiki/App/Xtn/Mediawiki/Math/Setup.html
index f54de20c5..ba0e243e0 100644
--- a/home/wiki/App/Xtn/Mediawiki/Math/Setup.html
+++ b/home/wiki/App/Xtn/Mediawiki/Math/Setup.html
@@ -48,13 +48,13 @@
XOWA uses MathJax[1] as the default method for LaTEX support. No additional setup is required, and performance will often be quicker than a standard LaTEX application.
The Score extension depends on LilyPond. This package is fairly large (90 MB) and not portable (i.e.: it must be installed).
@@ -59,7 +59,7 @@
The following are installation instructions per operating system.
The Wikimedia Foundation began rolling out Scribunto/Lua to its sites on 2013-02-15 and finished on 2013-03-13 (http://blog.wikimedia.org/2013/03/14/what-lua-scripting-means-wikimedia-open-source/ . Data dumps after 2013-02-15 will probably have {{#invoke}} in their wikitext, which requires a lua processor.
@@ -77,7 +77,7 @@
Beginning with v0.3.2, XOWA included preliminary support for Scribunto. As of v1.3.1, the functionality level is approximately 95%+.
Linux / Mac OS X users will need to grant Execute permission to the Lua binary. Note that XOWA tries to do this automatically. If it fails, you will need to handle it manually by doing any one of the following (note you will need to replace <OS> with your system):
@@ -209,7 +209,7 @@
XOWA packages a modified version of the luaj-jse-3.0 jar. Note that 3.0 was selected as it is the latest code branch and it fixes errors in 2.0.3.
@@ -221,7 +221,7 @@
Additional files are also at /xowa/bin/any/php/mediawiki/extensions/Scribunto/engines/Luaj/
XOWA used the following files from Scribunto:
@@ -269,7 +269,7 @@
XOWA modifies many of the lua files in order to cache library data across multiple page loads (Scribunto reloads the libraries for every page)
- os.date does not accept UTC format
+ os.date does not accept UTC format[edit]
@@ -402,7 +402,7 @@ if (s.equals("*t")) {
}
- string.gsub fails with out_of_bounds error
+ string.gsub fails with out_of_bounds error[edit]
@@ -425,7 +425,7 @@ if (s.equals("*t")) {
if (soffset >= srclen) break; // assert soffset is in bounds, else will throw ArrayIndexOutOfBounds exception;
- string.gsub fails if string is empty
+ string.gsub fails if string is empty[edit]
@@ -445,7 +445,7 @@ if (s.equals("*t")) {
if (srclen == 0) return varargsOf(src, LuaValue.ZERO); // exit early
- string.format ignores precision for double args
+ string.format ignores precision for double args[edit]
None of these changes affect the luaj_xowa.jar. They are noted for comprehensiveness's sake.
@@ -939,7 +939,7 @@ class Xowa_fxt {
Note that the $engines variable refers to /xowa/bin/any/lua/mediawiki/extensions/Scribunto/engines/
The following is only a partial list of JTidy changes. Multiple changes were made for v1.6.2.1 of XOWA to have JTidy be more "tidy-like". In addition, more changes will probably occur in the future to close the gap in source code between tidy and JTidy.
- ParseBlock should handle exiled variable during element reparenting
+ ParseBlock should handle exiled variable during element reparenting[edit]
@@ -130,7 +130,7 @@
- Do not trim empty block element if it has attributes
+ Do not trim empty block element if it has attributes[edit]
@@ -160,7 +160,7 @@
- Do not convert empty <p> to <br>
+ Do not convert empty <p> to <br>[edit]
@@ -193,7 +193,7 @@
- Do not add \n after <span> in <pre>
+ Do not add \n after <span> in <pre>[edit]
The Page sync feature is still a work in progress. The following are known issues:
- Math, Helper Buttons (enlarge / more info), Musical scores, and other images don't work
+ Math, Helper Buttons (enlarge / more info), Musical scores, and other images don't work[edit]
Wikipedia stores some images in a separate location. XOWA still needs code to detect this location, copy it offline, and show it correctly. This should be done in the next few releases, but in the meantime it's heavily recommended that you don't use Automatic sync for all pages. In particular, math pages will lose all equations after a sync. For example, https://en.wikipedia.org/wiki/Pythagorean_theorem
@@ -154,7 +154,7 @@
XOWA stores only the latest version of a page. Previous versions of the page will not be available after synchronization. This feature will be added in a future version
@@ -192,7 +192,7 @@
- No synchronization for new pages
+ No synchronization for new pages[edit]
A page must exist in the offline wiki in order to be synchronized. New pages cannot be synchronized. Navigating to a new page will just result in a "Page not found" error.
@@ -201,16 +201,16 @@
This feature will also be added in a future version
Other issues may be present. Please check https://github.com/gnosygnu/xowa/issues/72 for updates. Once the issue is closed, then the Page Sync feature will no longer be marked "Work in progress" and should be fully operational
This is an overview of what occurs when the Sync link is pressed
@@ -308,7 +308,7 @@ https://en.wikipedia.org/w/api.php?action=parse&format=json&redirects=1&
Automatic sync uses the same process as Manual Sync. The main process is as follows:
diff --git a/home/wiki/App/Xtn/Scripting.html b/home/wiki/App/Xtn/Scripting.html
index 78e6a28d2..8c1c1df23 100644
--- a/home/wiki/App/Xtn/Scripting.html
+++ b/home/wiki/App/Xtn/Scripting.html
@@ -95,13 +95,13 @@
function xo_uppercase(s)
diff --git a/home/wiki/Archive/App/UI/Main_window_layout.html b/home/wiki/Archive/App/UI/Main_window_layout.html
index 69ae66647..e1753ce16 100644
--- a/home/wiki/Archive/App/UI/Main_window_layout.html
+++ b/home/wiki/Archive/App/UI/Main_window_layout.html
@@ -24,7 +24,7 @@
All sections are designed to be copied and pasted directly to xowa.gfs.
- Increase font size to 10
+ Increase font size to 10[edit]
This section increases the font size to 10 and adjusts the sizes/positions accordingly
@@ -48,7 +48,7 @@ app.gui.layout
;
- Increase font size to 30
+ Increase font size to 30[edit]
A more extreme example: font gets changed to 30, so
@@ -73,7 +73,7 @@ app.gui.layout
;
- Use absolute positions
+ Use absolute positions[edit]
Note that this will cause window resizing to have no effect (EX: shrink the window to 800, but the html_box will remain 1000)
diff --git a/home/wiki/Archive/Help/Known_issues.html b/home/wiki/Archive/Help/Known_issues.html
index 5613a7b57..eb0b1c848 100644
--- a/home/wiki/Archive/Help/Known_issues.html
+++ b/home/wiki/Archive/Help/Known_issues.html
@@ -18,7 +18,7 @@
The following is a list of extensions that are not implemented in XOWA. It is an incomplete list. Any unimplemented extension will render as xml text.
diff --git a/home/wiki/Archive/Help/Version_compatibility.html b/home/wiki/Archive/Help/Version_compatibility.html
index 1734beb55..7a5dd1edd 100644
--- a/home/wiki/Archive/Help/Version_compatibility.html
+++ b/home/wiki/Archive/Help/Version_compatibility.html
@@ -35,7 +35,7 @@
As a result of this strategy, certain files/directories may be created that are no longer used anymore. If you have questions about these files, or just want to delete them, you should consult the sections below.
This section is relevant only if:
@@ -38,7 +38,7 @@
Note that you may need to redownload language packs in future releases. MediaWiki supports a tremendous number of languages, and XOWA is still working on reaching the same level of support.
This section is relevant only if:
@@ -101,7 +101,7 @@
Note that this will be the last time you will need to re-enable these choices. These settings will be saved in a separate file[1] which future versions of XOWA will not change.
diff --git a/home/wiki/Archive/Import/Batch.html b/home/wiki/Archive/Import/Batch.html
index ac6f7233d..54427e9f6 100644
--- a/home/wiki/Archive/Import/Batch.html
+++ b/home/wiki/Archive/Import/Batch.html
@@ -32,7 +32,7 @@
XOWA allows you to import multiple wikis with one command. Note that these instructions are Windows-centric. Linux/OS X users should be able to extrapolate.
- Decompression program
+ Decompression program[edit]
- Sqlite vs XOWA text file hive
+ Sqlite vs XOWA text file hive[edit]
XOWA text file advantages:
diff --git a/home/wiki/Archive/Import/Sqlite.html b/home/wiki/Archive/Import/Sqlite.html
index 2063cf7a4..4c63b17c2 100644
--- a/home/wiki/Archive/Import/Sqlite.html
+++ b/home/wiki/Archive/Import/Sqlite.html
@@ -32,13 +32,13 @@
As of v0.6.2, XOWA offers the ability to save a wiki in one sqlite database (as opposed to many text files). For more details about sqlite vs text files see Archive/Import/Overview.
- Sqlite model database
+ Sqlite model database[edit]
Every .sqlite3 database is copied from one central source: /xowa/bin/any/sql/xowa/xowa.sqlite3. The SQL used to generate the database can be found at xowa.sql file in the same directory.
XOWA displays images by using online downloads as specified in Dev/File/Setup. However, XOWA can also be setup to use offline sources. If you have the time and storage space, you can download all the images for your wiki and run them from a hard drive. Note that the full tarball set for English Wikipedia is over 2 TB and may take 15 days to download and unzip. Even a small wiki like Simple Wikipedia requires 56 GB. Please prepare accordingly.
Two changes will have to be made to the config file:
@@ -154,7 +154,7 @@
Note: the .fsys_('wnt') is not needed for Linux systems. It is a "hack" for Windows systems to handle File titles that have invalid Windows NT filesystem characters (such as " or :)
Dumping all the thumbnails in a wiki is currently being implemented. See Dev/Design/Offline_files
diff --git a/home/wiki/Blog.html b/home/wiki/Blog.html
index c04fdec44..64e15756e 100644
--- a/home/wiki/Blog.html
+++ b/home/wiki/Blog.html
@@ -25,13 +25,13 @@
- Release: v4.5.0.1703 (2017-03-29 16:00 Wed)
+ Personal: A new job and other changes (2017-04-02 12:00 Sun)[edit]
- The PC version is a major release. It adds full-text search for the Wikipedias, redesigns Special:XowaSearch, and fixes parsing errors in 2017-03 Russian Wikipedia.
+ XOWA development will be undergoing some changes in the coming months. As of tomorrow, I'll be starting a new job, and consequently, I won't be able to give as much time to XOWA as before. In fact, few people know this, but I spent the past year working full-time on XOWA. So, strictly by numbers, XOWA is going to go from a 60-80 hour per week schedule to something much less.
- The Android version is a major release. It also adds full-text search for the Wikipedias.
+ With that said, XOWA development will not halt. As demonstrated by the full-year work effort, I care deeply about this project, and I do not plan to stop developing XOWA any time in the future. However, it does mean that there will be a few changes.
-
- (Wiki) Publish 2017-03 English Wikipedia, 2017-03 Russian, 2017-03 Hindi, and 2017-03 Tibetan wikis
-
- These wikis were uploaded over the course of the month. You can get them from Download Central or see the following links:
+ First, the pace of development will slow down. The past year has seen a lot of development: from XOWA Android to Download Central to personal wikis to full-text search[1] Given the new schedule, it won't be at all possible to match that output. I still have a bunch of major changes planned, but I expect that only two or three major changes will occur before the end of the year.
+ Second, I'll be producing Download Central wikis at a slower rate. I do want to do a full update of all wikis, especially with the recent addition of full-text search. However, if I run into issues, I may postpone a wiki for a few weeks to a month until I work them out. I'll try to provide some sort of schedule for changes, but things may be in flux for a while. As always, if you have any requests, please make them, and I'll definitely prioritize them.
+
+
+ Third, I'm going to turn my attention to making XOWA easier for other developers and power users. This means more documentation in building XOWA as well as the Download Central databases. I'd love to have some support from others, and really don't want to have XOWA development depend entirely on me.
+
+
+ I'm sure there will probably be other noticeable changes as well. Again, I want to assure you that XOWA is not going to go away anytime soon. If anything, it will continue to grow -- especially with more support from others.
+
+
+
+ ^There's also a lot more such as HTML databases, PageRank, Auto-complete URL bar, Page Sync, Options, ICU Categories, Page Banner, multi-threaded parsers, nightmode, hdpi support, and dozens of parser issues.
- XOWA finally supports full-text search. This was a complicated change involving a new Special page (Special:XowaSearch) and a new Java library (Lucene). There will be more changes in future releases, but the current version should work well enough for PCs as well as Android devices.
-
-
- Right now, full-text search indexes are only available for download for 2017-03 English Wikipedia. To get it, see App/Full-text_search/Lucene/Search_indexes/Getting. Note that future wikis will have full-text search indexes automatically included with them.
-
- (PC) Redesign full-text search Special Page. See: Special:XowaSearch
-
-
- A basic version of Special:XowaSearch was released to allow full-text search for personal wikis. The current version cleans up the UI and adds features like paging and highlighted snips.
-
-
- (PC) Add search and allpages button
-
-
- In tandem with the above, XOWA now has two separate buttons:
-
-
-
- Search by full-text, as identified by the magnifying glass.
-
-
- List all pages alphabetically, as identified by the list icon.
-
- (PC) Fix wikibase "attempt to call nil" errors for 2017-03 Russian wikis
-
-
- The 2017-03 Russian Wikipedia had a bunch of Script errors with "attempt to call nil". Most of these involved many Wikibase changes introduced over the past year, but finally used in a Module within Russian Wikipedia. These errors have been fixed with the current version
-
-
- (PC) Fix minor issues including page_sync requiring double refresh, long directory names for images, and rare import errors
-
-
- There are basically three issues worth highlighting:
-
- Imports would fail due to corrupt dumps. Russian Wikipedia outputted two identical titles with different page_ids. This caused XOWA to fail during import
-
-
-
- (PC) Add minor GUI changes including custom url formats, direct HTML from SWT browser, and options link
-
-
- These are a few minor changes worth detailing:
-
-
-
- Custom url formats are now available. This was in response to Ope30 and a way to customize the displayed url. For more info, seeSpecial:XowaCfg?grp=xowa.gui.url bar
-
-
- View HTML can now show the actual HTML in the browser. Previously XOWA would show the generated HTML as shown for the Read tab. However, this wouldn't work for Special pages due to javascript changes to the DOM. Now, the actual HTML in the SWT browser is available by changing the option at Special:XowaCfg?grp=xowa.wiki.hdumps
-
-
- Options link for Special:XowaCfg pages. XowaCfg pages allow direct linking to certain groups by using ?grp=code. If you want the direct link to a specific option page, you can now right-click on the "options link" and copy it
-
-
-
- Next release
-
-
-
- Brief hiatus: I'll have more details on this in another blog post, but in short, I'm starting a new job in a week, and will not be able to devote as much time to XOWA as before.
-
-
-
-
-
-
- Release: v4.4.0.1703 (2017-03-07 18:00 Mon)
-
-
- The PC version is a major release. It adds night mode, automatic page backup, performance improvements, an early-version of full-text search, and better support for French Wikipedia.
-
-
- The Android version has no release.
-
-
- Note that there are no upgrade versions for v4.4. This is due to XULRunner changes which would make the upgrade almost as large as the entire app.
-
-
- (Wiki) Publish 2017-02 German Wikipedia and 2017-02 French Wikipedia
-
-
- Both wikis were updated during the week. You can get them from Download Central or see the following links:
-
- XOWA now has night mode. To enable it, do Menu -> View -> Toggle Night mode. More info is at App/UI/Night_mode
-
-
- I implemented this feature over the past few days, so there may be some spots I missed. Also, if you have any suggestions about colors, CSS, or icons, please do contact me at Help/Feedback.
-
-
- (PC) Add page backup feature
-
-
- XOWA now does a simple backups whenever pages are edited. This feature is intended primarily for personal wikis.
-
- Make sure Enabled under Page backups is checked.
-
-
- Edit any page and press Save page.
-
-
- Go to /your_wiki_directory/user/temp/Page_title/. You will see a text file copy there
-
-
-
- (PC) Improve performance for starting app as well as creating / loading personal wikis
-
-
- This version has a number of performance improvements:
-
-
-
- Faster app startup on Windows machines: Previously, the xowa.exe / xowa_64.exe would pre-allocate 256 MB on startup. On some machines, this seems to make bootup 20 to 30 seconds long. This build now doesn't allocate any pre-determined amount.
-
-
- Faster personal wiki creation: XOWA used to try to download a Wikimedia css for personal wikis. Now, XOWA will just use the default css
-
-
- Faster personal wiki loading: XOWA used to load a database connection to every personal wikis at bootup. Now, XOWA will only load the database connection when it's opened.
-
-
-
- (PC) Update XULRunner to v31 for Windows machines
-
-
- The Main Page for 2017-02 French Wikipedia now uses the CSS flex directive. Unfortunately, this is not supported in XULRunner v24 but it is in XULRunner v31.
-
-
- This is how XOWA handles this on different operating systems
-
-
-
- For Windows machines, XOWA now uses XULRunner v31. Note that 64-bit XULRunner is no longer available for download, so I used a copy I had downloaded a few years ago.
-
- For Mac OS X machines, this shouldn't be an issue, as XOWA uses webkit already.
-
-
-
- (PC) Add preiminary full-text search for personal-wikis
-
-
- XOWA now has a basic full-text search feature. It should only be used for small wikis (like a personal wiki). It works by opening up every single page and searching for the text phrase. Although this sounds slow, it performs relatively quickly on modern generation machines (especially if you have a SSD). It also has the advantage of not taking up any space for search-indexing.
-
-
- This feature will be expanded in the coming months, but any feedback is welcome. To try to it, go to Special:XowaSearch
-
-
- (PC) Other minor fixes, including ?curid for command-line and no more current directory for logs
-
-
- There are a bunch of other minor fixes, but I'll highlight two which were reported by users:
-
-
- ?curid did not work on the command-line
-
-
- XOWA added a ?curid feature to look up a page by page-id. Unfortunately, this wasn't working for command-line calls.
-
-
- This build fixes this bug.
-
-
- No more current directory for logs
-
-
- XOWA stores its logs at C:\xowa\user\anonymous\app\tmp\log. XOWA used to store the current directory in a folder called current. Unfortunately, this caused problems on Linux systems when two or more different-permissioned users were running XOWA.
-
-
- This version replaces the current directory with a timestamp directory which should now reduce the likelihood of errors.
-
-
- Next release
-
-
-
- Full-text search: I need to polish up the full-text search for personal wikis. In addition, I'm going to look at getting it working for the Wikimedia wikis
-
v1.12.2 was another quick release. I generated images for the Arabic wikis.
@@ -171,7 +171,7 @@
v1.12.3 will continue the same trend. I'm going to do a refresh of the Polish wikis, but have nothing else planned.
v1.12.1 was another simple release. I generated images for 2014-11-24 French Wikipedia and fixed a few parser bugs.
@@ -180,7 +180,7 @@
v1.12.2 will probably continue with short releases. I'm still working on a simple Android alpha for Simple Wikipedia.
v1.11.4 was yet another short release. I generated images for 2014-11-06 English Wikipedia, but did little else.
@@ -189,7 +189,7 @@
v1.12.1 will continue the trend of short releases. I'll start working on some alpha HTML dumps for Simple Wikipedia / English Wikisource.
v1.11.3 was another short release. I made a run through 2014-11-06 English Wikipedia, and it appears mostly okay, though there was one issue related to unclosed <imageMap> and Canadian pages. Aside from a few issues releated to <indicators> and one Scribunto badges issue affecting frwiki, I did nothing else.
@@ -198,7 +198,7 @@
v1.11.4 will probably be another short release. I'll generate an update for English Wikipedia, but it's unlikely that there will be anything more.
v1.11.2 was also a short release. I've not had much time this week, and this may continue for a while. I did manage to work on Schnark's tickets, and did manage to generate an update for German wiki. In addition, I went through the last of the 50,000 wikis including Latvian, Nynorsk and Cebuano. As of now, all wikis lists as 50,000+ articles now have XOWA packages within the last 6 months. This also includes all the sister wikis as well (wiktionary, wikisource, etc)
@@ -207,7 +207,7 @@
v1.11.3 will still be a short release. I'm going to try to generate an update for English Wikipedia, but that may slip till next week. In addition, I'll work on a Latin update.
v1.11.1 was an abbreviated release. I had some personal affairs that took up much of most of the week. I started working on the German Wiki image update, but didn't have the time to complete it. I added a few minor bug fixes, but that was it.
@@ -216,7 +216,7 @@
v1.11.2 should see a German Wiki image update. Unfortunately, personal matters may also keep me from making progress this week also. I'm hoping to get further in Android, but it looks like the timetable may slip.
v1.10.4 had a number of fixes for Russian Wikipedia -- nearly all of which involved Scribunto and Wikidata. I continued on Android and have a fairly workable prototype. I've also started rewriting the Android database serialization to be more compressible. This is going to be a somewhat time-consuming task, but I'm hoping to be able to generate an entire HTML text dump of English Wikipedia in 25 GB. (contrast that with the current Wikitext dump of 19 GB)
@@ -225,7 +225,7 @@
For v1.11.1, I'm going to keep it light. I'm planning on doing a German update and a new Latvian package. In the meantime, I'm going to continue working on database format / compression.
I thought it would be worthwhile to give a general overview, so that some expectations can be set.
@@ -279,7 +279,7 @@
I'll set up a thread later in the XOWA forum to get more feedback.
v1.10.3 was a straightforward release. Most of this had to do with 2014-10-03 English Wikipedia dump being relatively uneventful (unlike the last few monthly dumps). Vietnamese and Lithuanian were also straightforward, though a few pages in Vietnamese Wikisource forced a rewrite of the XOWA poem parser. In addition, due to the similarity of the lt and li language codes, I ended up doing Limburgish by mistake. However, it was small enough to upload anyway. In the meantime, I plugged away at the Android app, and have a bare-bones prototype for Simple Wikipedia.
@@ -288,7 +288,7 @@
For v1.10.4, I'm going to go out of order and do a Russian rebuild. Russian Wikipedia tends to use Scribunto a lot, and I'd just like another check that XOWA's Scribunto rendition is still working well. I'll add Estonian and maybe Latvian. Otherwise, I'll work on some database optimizations for the Android app.
v1.10.2 includes some major changes to the javascript file layout. This should not be noticeable to most users, but for any one interested in the details, you can review this ticket. Aside from that, I worked a bit on Android and have a primitive alpha for Simple Wikipedia.
@@ -297,7 +297,7 @@
For v1.10.3, I'm going to do an English image update. I'll continue on the Android app, and should be getting closer to a workable prototype. For wikis, I'll be working on Vietnamese (update) and Lithuanian (new).
For v1.10.1, I spent a lot of time on the wikidata.js replacement. I decided to reproduce the current look and feel for the Wikidata site. I think the final results are pretty good.
@@ -306,7 +306,7 @@
For v1.10.2, I'm going to go back to Android. For wikis, I'll be working on Norweigian (update) and Galician (new).
v1.9.5 was mostly involved with a small number of minor parser fixes. Otherwise, English Wikipedia looked good (I reviewed over 100 pages) while Waray-Waray was much smaller than I expected. In addition, I worked on wikidata.js, but decided to incorporate this functionality directly in XOWA's Java code. (For more information, see below). I didn't finish the wikidata.js replacement for this release, but it should be done for v1.10.1. Otherwise, I worked a little on some XOWA Android experimentation.
@@ -315,7 +315,7 @@
For v1.10.1, I'm going to finish up the wikidata.js replacement. In addition, I'll start working on an Android prototype for Simple Wikipedia. For wikis, I'm planning to work on Thai (update) and Slovenian (new).
First, as background, the Wikidata.js file was developed by Schnark as a way to view Wikidata pages within XOWA. You can see a screenshot here. As with all of Schnark's contributions, it was a well-developed piece of code that has performed its task perfectly for over a year and a half.
@@ -347,7 +347,7 @@
So, after much internal debating, I decided to make the v2 version for Wikidata within XOWA's Java code. I'm still going to leave the v1 infrastructure in place. If anyone wants to upgrade it to v2, they can do so, though I'm hoping the new version should perform well enough.
Most of my time for the v1.9.4 release was spent on wikidata. As mentioned earlier, the latest wikidata dump introduced a brand new schema. More interestingly, the dump had articles in both the old schema (Q933) and the new schema (Q2). I had to rewrite a good deal of XOWA"s wikidata parser to handle two schemas, as well as implement the new schema. This took up most of my time for the v1.9.4 release, and I'm still not really done.
@@ -359,7 +359,7 @@
For v1.9.5, I'm going to focus on finishing up wikidata issues. Primarily, the wikidata.js page doesn't work for the new schema (navigating to Q2 will show a lot of errors). I'm also going to try to add better qualifier / reference support. In addition, there will probably be a handful of minor English Wiki issues that will take some time. Aside from English Wiki, I'll try to do the Waray-Waray wikis, but that may end up spilling over to the following week.
- Latest version of Wikidata is not compatible with XOWA v1.9.3 (2014-09-17 23:05 Wed)
+ Latest version of Wikidata is not compatible with XOWA v1.9.3 (2014-09-17 23:05 Wed)[edit]
It turns out that the 2014-09-12 Wikidata dump has a brand new schema and can't be imported into XOWA.
@@ -368,7 +368,7 @@
I'm working on a v2 parser now, and should have it ready for v1.9.4. In the meantime, please hold off on updating Wikidata.
The v1.9.3 release has a handful of minor changes for the Simple wikis. I spent more time on Android development, and got an experimental dump working. However, it's still going to be a few weeks before I get any sort of alpha ready.
@@ -380,7 +380,7 @@
v1.9.4 will continue along with Android. For wikis, I'm going to do Portuguese (rebuild) and Slovak (new).
The v1.9.2 release has several minor changes for English Wiktionary and Wikisource. Some were quite time-consuming, including one Luaj issue with .pairs(). I also decided to hold off on more HTML dump work, because I want to see how they perform in Android before I commit to the HTML dump format. Towards that end, I started working on the Android version this week, though so far most of the work is quite experimental.
@@ -389,7 +389,7 @@
v1.9.3 will involve more Android work along with HTML dumps. For wikis, I'm going to do Hungarian (rebuild) and Esperanto (new).
The v1.9.1 release has some significant changes for the Chinese wikis, particularly Chinese Wikipedia and Wiktionary. Otherwise, most of the work went into more changes for the HTML dumps. At this point, I'm hoping that the main XOWA program is stable enough, and that any other major changes can wait until after an Android version.
@@ -398,7 +398,7 @@
v1.9.2 will still involve more HTML dump work. I'm also going to try to get a prototype going in Android, and make sure that the HTML dump approach works as planned. For wikis, I'm going to do English sister wikis (Wiktionary, Wikisource, etc.) and Hungarian Croatian (new).
The v1.8.4 release has a handful of changes for English Wikipedia. Some of these were quite interesting (particularly the railway maps and the automatic-new-line-if-needed), though fortunately none of these should be major. Otherwise, I spent more time on the HTML dumps. It's taking longer than I expected, but I should definitely have something ready for a v1.9.* release.
@@ -421,7 +421,7 @@
As for the next release, v1.9.1 is a monthly milestone, so I plan to keep changes to a minimal. I'll probably spend most of my time on HTML dumps and hope to have a workable prototype. For wikis, I'm going to do Chinese (rebuild) and Serbo-Croatian (new).
The v1.8.3 release is mostly about minor changes for the French and Polish wikis. In addition, there is a handful of fixes for the 2014-08-11 English wiki (which looks good so far). The SWT upgrade got put on hold as I ran into an issue on a Linux 32 bit box, and decided it wasn't worth the risk to upgrade any of the other platforms. (though it looks like a Linux only issue: SWT 4.4 requires GTK 3). Aside from that, I spent most of the week on the HTML dumps.
@@ -430,7 +430,7 @@
For v1.8.4, I'm going to continue with the HTML dumps. I'm hoping to have a beta feature ready within the next few releases. Other than that, I'm going to release the images for 2014-08-11 English wiki and probably do Arabic.
The v1.8.2 update is larger than usual. I had to regenerate the language files because MediaWiki v1.24 added "!" as a magic word and German Wikipedia dropped Template:!. Since this was a low-level change, it forced a rebuild of all the language files. I also took the opportunity to move the language files from /xowa/user/anonymous/lang/xowa/ to /xowa/bin/any/xowa/cfg/lang/core/. I also did the same for /xowa/user/anonymous/wiki/#cfg/ to /xowa/bin/any/xowa/cfg/wiki/core/
@@ -465,7 +465,7 @@
- Github Forks of Luaj and JTidy (2014-08-08 23:50 Fri)
+ Github Forks of Luaj and JTidy (2014-08-08 23:50 Fri)[edit]
I had to make some more changes to the Luaj project for v1.8.2. I decided that it was time to put the luaj_xowa project under some sort of DVCS, so I set up a github repository here. I also set up one for jtidy_xowa.
@@ -474,7 +474,7 @@
I'm also going to stop uploading these source tarballs to the XOWA support area, since they're basically redundant. Hopefully this won't inconvenience anyone.
v1.8.1 was a light release with some minor UI fixes. This included the new collapsible wikidata div, as well as some code to handle a bread crumb trail for leaf pages. Japanese and Bulgarian wikis were straightforward, though due to some archive.org issues, it looks like the uploads won't be ready until sometime tomorrow.
@@ -483,7 +483,7 @@
For v1.8.2, I'm going to continue working on the HTML dumps. It'll probably be a few weeks before I have anything to show, but when I'm done, it should be the basis for the Android app. For wikis, I'm planning to do a rebuild of German and generate new images for Danish.
v1.7.4 was mostly about the ImageMap extension. It took quite a bit of time, but I think the end result was worthwhile -- particularly with Popups. You can check the urls listed in the Change Log. I also added some "popup-at-anchor" functionality, though this will be limited until XOWA starts generating full html pages. In addition, there were some more Scribunto changes -- this time with Wikibase. I added a few minor UI changes in order to make "startup-from-previous-session" the default. I also went through the Ukrainian and Greek wikis. Finally, I uploaded the "slimmer" English Wikipedia set. You can check it out at https://archive.org/details/Xowa_enwiki_latest.
@@ -495,7 +495,7 @@
For v1.8.1, I'm going to try to keep it simple. I'll work on some general performance enhancements and revise some of the documentation. For wikis, I've decided to continue on with the rest of the 50,000+ wikis. Bulgarian will be next, and Japanese will be paired with it.
- Fixed: English Wikipedia images for 2014-07-07 (2014-07-22 21:02 Tue)
+ Fixed: English Wikipedia images for 2014-07-07 (2014-07-22 21:02 Tue)[edit]
- Technical difficulties: English Wikipedia images for 2014-07-07 (2014-07-21 22:54 Mon)
+ Technical difficulties: English Wikipedia images for 2014-07-07 (2014-07-21 22:54 Mon)[edit]
The English Wikipedia images is currently offline. I noticed a minor problem, and thought I could upload a fixed version. Unfortunately, I didn't expect archive.org to keep timing out on me. I'm going to continue trying tonight but it may be another day or so before the new version is up. Sorry about the delays.
v1.7.3 had more follow-up Scribunto changes. These affected only a handful of pages (less than 50 out of 4.5 million). I think I'm done with the latest Scribunto changes, and hopefully the next changes won't be as traumatic. In addition there were two notable fixes: missing references due to lower-alpha, and excessive ampersands on some math pages. I added a few UI options, including the set-startup-page option. Hebrew wasn't as difficult as I expected, though it still involved a few changes.
@@ -546,7 +546,7 @@
For v1.7.4, I'm going to try to release a fully functional ImageMap extension. I'm hoping this will be useful now that App/Xtn/Html/Popups is in place. I'm also going to try to do XULRunner 24, though if I run into issues, I may defer this till a v1.8 build. For wikis, I'm going to skip over Japanese and do Ukranian as the latter uses Scribunto heavily. I'll probably do Greek as well.
v1.7.2 was quite a release. I downloaded the latest enwiki, and found a whole host of issues due to recent changes in Scribunto. As a result, there were a lot of changes to XOWA's Scribunto for this release. Hopefully I've caught all the major issues. In addition, I started working on XULRunner 24, but was diverted to some memory performance issues. Also worth mentioning is an important item for certain non-English wikis: case-insensitive UTF-8 lookups. The latter was especially time-consuming for a language like Turkish, which has asymmetric casings: İ lowercases to i but i uppercases to I. Fortunately, in comparison to the above, Swedish and Malay were easy to do.
@@ -555,7 +555,7 @@
For v1.7.3, I still need to do some additional cleanup in the wake of all the Scribunto changes from last week. In addition, I'm going to do another images update, and hopefully I'll be able to do a smaller English Wikipedia images dump size. For wikis, I'm going to try to do Hebrew, but that may spill over to the following week (I'm always nervous with RTL wikis).
- Cleaning up the download area (2014-07-07 21:29 Thu)
+ Cleaning up the download area (2014-07-07 21:29 Thu)[edit]
Another administrative note. I decided to clean up the download area last night: https://sourceforge.net/projects/xowa/files/ There were a lot of old releases dating back to 0.3.0, with a few gaps inbetween. I've wanted to do it for quite a while, but I never like deleting files.
@@ -599,7 +599,7 @@
Finally, if anyone wants a full historical release set (for example, 1.1.1), feel free to drop me an email. I'll post a copy temporarily to my Google drive account. Note that all hashes for the release sets are in https://sourceforge.net/projects/xowa/files/support/ so you can cross-check the copy if you don't trust me. :)
v1.7.1 was more interesting than I expected. The Russian wikis had the expected Scribunto issue, but Serbian had a whole host of issues related to variants. I added a good deal of basic support, though I'm sure there are still some items missing. If any Serbian users can report any actual errors in articles, I'd greatly appreciate it.
@@ -611,7 +611,7 @@
For v1.7.2, I'm planning to makes some more non-English wiki related changes, thanks to some of the Russian wiki changes from last week (particularly, case-insensitive lookups for UTF-8 characters). I'm going to look at upgrading XOWA from XUL Runner 10 to 24, now that SWT 4.4 is officially relesed. I'm also going to try again to look at English Wikipedia images dump size. There'll probably be some GUI changes as well. For wikis, I'm going to do Malay and Swedish.
- A change to the url format for archive.org links (2014-07-03 23:34 Thu)
+ A change to the url format for archive.org links (2014-07-03 23:34 Thu)[edit]
A note on a minor bookkeeping change. Starting on 2014-06-22 and with the Latin wikis, I've removed the date based component from the url. So, with the example of the Latin wikis, the previous format was Xowa_labundle_2014-06-23_including_wikipedia, whereas the current format is Xowa_labundle_latest_including_wikipedia.
@@ -626,7 +626,7 @@
Hopefully I won't run into any issues with this approach. If I do, I'll just go back to the date-based urls.
v1.6.5 was mostly minor parser fixes for English Wikipedia. I also included a few minor changes to the Popups, thanks to feedback from Schnark
@@ -635,7 +635,7 @@
v1.7.1 will be a stable release, so I'm going to try to keep changes to a minimum. I'm planning to work on some performance enhancements to popups, in preparation for making it the default in v1.7.1. I will also go back to reducing the size of the English Wikipedia images dump. For wikis, I'm going to try Serbian and maybe Russian. If Russian is too difficult (they tend to be the most experimental with Scribunto), then I'll switch them with Swedish instead.
Due to some technical complication, I had to redo the English Wiki scan mid-week. As a result, I didn't get a chance to look at reducing the size of the dump. While waiting, I pretty much ended up spending all my time on the new Popups feature. For an initial version, I think it turned out fairly well. I'm hoping others will find it useful.
@@ -644,7 +644,7 @@
v1.6.5 will involve some work on minor parser issues. The latest English Wiki has a few issues that I didn't get a chance to review. I'll also look at some tweaks / performance enhancements to popups, and try to include some other UI changes. For wikis, I'm going to resume with Spanish and Romanian.
v1.6.2 was mostly about infrastructure changes. I changed tidy to parse only page content, while cleaning up most of the HTML <head> generation. Both these items took longer than expected. I did manage to add options to handle auto-collapse / auto expand, and included a few javascript refinements thanks to Schnark.
@@ -653,7 +653,7 @@
v1.6.3 will shift focus a bit. The enwiki dump finally started, and I'm going to try to change the update process to delete unused files. Enwiki is approximately 86.4 GB and has a turnover of 1 - 2 GB per month. If the unused images are deleted, I'm hoping to get back into the 70s, if not lower. I'm also going to explore an automated update option for these image databases. As most of my attention will be on enwiki this week, I'm going to skip generating wikis for other languages. Finally, I'm going to experiment with Hovercards in XOWA. If I'm lucky, I may be able to get something in for a v1.6.* release. Otherwise, it'll have to wait for XOWA HTML dumps.
With v1.6.2, I included a significantly different JTidy. I ported as many of the changes from tidy over to JTidy -- mostly in the various Parse classes. I still have more changes planned for JTidy, but hopefully the bulk of the compliance work has been done. I was able to do a full parse of all the English Wikipedia pages, and the new JTidy jar helped me discover a few minor issues in the Wikipedia namespace. I also added a bunch of minor UI changes, including new privacy options and several Tab actions (Close Others, Undo Close Tab, Select by #)
@@ -662,7 +662,7 @@
For v1.6.3, I'm planning to work on more JTidy related changes. Now that JTidy is fully integrated into XOWA, I need to remove some early XOWA tidy-like logic that prevents JTidy from fixing malformed HTML. I'll also add a few other minor UI changes as well, with some focus on Javascript changes (particularly auto-collapse all sections). For wikis, I'm planning on Indonesian (new) and Italian (update).
- About the blog (2014-06-06 23:56 Sat)
+ About the blog (2014-06-06 23:56 Sat)[edit]
I thought it might be useful to have a blog that covers various parts of XOWA's development. Its main objectives would be the following:
diff --git a/home/wiki/Blog/2015.html b/home/wiki/Blog/2015.html
index 9f6e24e26..f010a328c 100644
--- a/home/wiki/Blog/2015.html
+++ b/home/wiki/Blog/2015.html
@@ -566,7 +566,7 @@
I'm skipping the release again. There were two minor changes, but neither seem to be enough to warrant another version. As always, if anyone notices any serious issues, please do let me know at either https://github.com/gnosygnu/xowa/issues or gnosygnu at gmail.com .
@@ -584,7 +584,7 @@
For wikis, I'll try to do a refresh of French Wikipedia.
I'm skipping the release this week as well. I've spent the week working on the new Android dump format for gallery, as well as a new database merge feature. I haven't found anything worth a release.
@@ -596,7 +596,7 @@
For 2.12.4, I'm still working on the new Android version for Simple Wikipedia.
I'm skipping the release this week. I've been working on Android-related changes, so there really aren't any significant changes.
@@ -608,13 +608,13 @@
For 2.12.3, I'm continuing work on the Android version for Simple Wikipedia. For wikis, I'll try to do Russian
v2.12.1 is a minor release. It has several fixes directly affecting Italian Wikisource pages, and a few minor parser fixes for other wikis
- Wiki bundles for Italian wikis
+ Wiki bundles for Italian wikis[edit]
The Italian wikis have been posted to archive.org
@@ -625,7 +625,7 @@
- Minor fixes for Italian Wikisource
+ Minor fixes for Italian Wikisource[edit]
These fixes addressed the following:
@@ -639,7 +639,7 @@
- Minor parser fixes including mapsource extension
+ Minor parser fixes including mapsource extension[edit]
These fixes are several, but the following are notable:
@@ -653,7 +653,7 @@
- Next release: v2.12.2
+ Next release: v2.12.2[edit]
I spent a good deal of time working on most of these minor fixes, so my progress on Android was limited. However, I did get a text version of Simple Wikipedia working with the new dump and the new UI. I'm planning to work on images this week, and hope to have a new beta for v2.12.2
@@ -662,7 +662,7 @@
For wikis, I'm generating English now. I'll try to add Arabic this week as well.
This week will be another skipped release. I've only made very minor changes this week, so it didn't seem worth it to make a new release.
@@ -677,13 +677,13 @@
v2.11.4 is a minor release. It has one fix affecting French Wikipedia pages, and another for the simple-mode Category system.
- Fix for "long-vertical scrolling" on French Wikipedia
+ Fix for "long-vertical scrolling" on French Wikipedia[edit]
In v2.11.2, I added a fix to handle extraneous pre sections: see #Fix for extraneous pre-sections in References. It turned out this fix was not correct, and caused pages in French Wikipedia to have large scrolling sections.
@@ -692,7 +692,7 @@
I reverted the fix for v2.11.4. As it turned out, the issue with extraneous pre sections was handled by the underlying templates themselves.
- Fix for simple-mode Category pages not loading
+ Fix for simple-mode Category pages not loading[edit]
XOWA generates a simple Category system when it builds a wiki (this is called v1). If you want an authentic version of the Category system (this is called v2), you can always import it separately under Import offline.
@@ -701,7 +701,7 @@
The simple Category system looks like it broke some time ago during the general database redesign from .sqlite3 to .xowa. I fixed it for this release.
- Wiki bundles for French, Lithuanian, Limburgish, Estonian, Latvian, Nynorsk, and Cebuano wikis
+ Wiki bundles for French, Lithuanian, Limburgish, Estonian, Latvian, Nynorsk, and Cebuano wikis[edit]
There were a lot of wikis this week, but they were mostly small. These have been uploaded to archive.org:
@@ -730,7 +730,7 @@
- Next release: v2.11.5
+ Next release: v2.11.5[edit]
I was able to do a basic HTML dump for simple wiki, but there are still a number of issues. These should be fixed this week, and hopefully I can try the new HTML dump system on English Wikipedia.
@@ -739,19 +739,19 @@
For wikis, I'm going to work through the last of the old .sqlite3 wikis and go through Dutch (nl.*) and Latin wikis.
v2.11.3 is a fairly minor release. It addresses one minor bug with "1. REDIRECT" showing up on pages.
- Fix for "1. REDIRECT" showing up on some pages
+ Fix for "1. REDIRECT" showing up on some pages[edit]
This was a bug I introduced while fixing another issue in v2.11.2. Some pages would now show "1. REDIRECT", most notably en.w:Earth
- Wiki bundles for Slovak, Slovenian, Galician, and Waray-Waray wikis
+ Wiki bundles for Slovak, Slovenian, Galician, and Waray-Waray wikis[edit]
These have been uploaded to archive.org:
@@ -771,7 +771,7 @@
- Next release: v2.11.4
+ Next release: v2.11.4[edit]
I fixed the one minor Wikibase issue, but am deferring a few other possible issues till later. I'm still chugging away on the HTML dump. My aim is to get a simple wiki dump for the next release.
@@ -780,13 +780,13 @@
I generated the English Wiki dump but there were only about 3 thousand new images, and I didn't feel that it merited an update. For wikis, I'm going to update French, and then go through as many as I can of Lithuanian, Limburgish, Estonian, Latvian and Nynorsk.
v2.11.2 is a significant release. It addresses minor, but noticeable issues with gallery sections, location maps, and references. It also has some Wikibase fixes.
- Fix for Gallery rendering vertically instead of horizontally
+ Fix for Gallery rendering vertically instead of horizontally[edit]
Wikimedia added a change a few weeks ago to force <gallery> tags to use a css. See https://phabricator.wikimedia.org/T110709 This resulted in galleries being shown vertically, instead of horizontally.
@@ -795,7 +795,7 @@
v2.11.2 now includes this css.
- Fix for Location maps not working on non-English wikis
+ Fix for Location maps not working on non-English wikis[edit]
This has been a bug for a few months, but I had misdiagnosed it as bad Module code. Basically, non-English wikis would copy-paste the same Module:Location_map code in to their wikis. This failed to work in XOWA, because:
@@ -815,7 +815,7 @@
v2.11.2 now uses the canonical name just like MediaWiki.
- Fix for extraneous pre-sections in References
+ Fix for extraneous pre-sections in References[edit]
I think this is also a recent bug, but I can't track down the actual cause. MediaWiki has inconsistent logic for trimming whitespace around template and link arguments. The one at issue was a piece of code like {{TemplateName| B\n }}. On my local version of MediaWiki (1.25.2), it doesn't trim the "\n " after the B and creates a <pre> section. However, on Wikipedia, it does trim the whitespace and does not create a <pre> section.
@@ -824,7 +824,7 @@
I think this behavior changed recently, but couldn't find the actual line of code in MediaWiki. For now, XOWA will automatically trim end whitespace for all template arguments. In my opinion this is more intuitive behavior anyway.
- Minor Wikibase fixes
+ Minor Wikibase fixes[edit]
These are a handful of signficant fixes that only affect some several dozen pages. They are in brief:
@@ -841,7 +841,7 @@
- Minor fixes for Redirect
+ Minor fixes for Redirect[edit]
These are two minor items worth more explanation:
@@ -855,7 +855,7 @@
- Minor JTidy fix to always enclose body text
+ Minor JTidy fix to always enclose body text[edit]
This was actually not working from the start. Basically tidy needs to take something like ...
@@ -876,7 +876,7 @@
I modified the jtidy_xowa.jar to handle this behavior.
- Wiki bundles for Danish, Serbo-Croatian, Croatian, and Estonian wikis
+ Wiki bundles for Danish, Serbo-Croatian, Croatian, and Estonian wikis[edit]
These have been uploaded to archive.org
@@ -896,7 +896,7 @@
- Next release: v2.11.3
+ Next release: v2.11.3[edit]
I made some good progress with the rewritten HTML dump feature this week, but am still not done. I'm hoping to get ready for v2.11.3 but I need to work on a few other minor issues that have spilled over from this week. (namely in Wikibase).
@@ -905,25 +905,25 @@
For wikis, I'm generating 2015-11 English Wikipedia. I'm also going to continue through the minor wikis and try to do Slovak, Waray-Waray, Slovanian and Galician
v2.11.1 is a minor release. There are a few minor fixes for Hebrew wikis.
- Minor fixes for Hebrew wikis
+ Minor fixes for Hebrew wikis[edit]
v2.11.1 now supports Hebrew dates for the time function like {{#time:xhxjj xjx xhxjY|28-08-1608 + 341 days}} generating ד' ה'שס\"ט". In addition there is basic support for Hebrew grammar like {{grammar:prefixed|וabc}} generating ווabc.
- Image packages for English Wikipedia, Hebrew, Norwegian and Vietnamese wikis
+ Image packages for English Wikipedia, Hebrew, Norwegian and Vietnamese wikis[edit]
The English Wikipedia update for 2015-10 is finally up. The rest of the wikis are up at archive.org
- Next release: v2.11.2
+ Next release: v2.11.2[edit]
I've been working on a new UI for the Android alpha. I've also spent time rewriting the HTML dump. For the next few weeks, I don't expect to do anything with the desktop app outside of bug fixing.
@@ -932,7 +932,7 @@
For wikis, I'll move on to Danish, Serbo-Croatian, Hungarian and Esperanto wikis
I'm skipping the release this week. I spent most of the time this week on the HTML dump as well as Android. I'm looking at doing the regular monthly release next week but don't expect any major issues.
@@ -941,13 +941,13 @@
I'm also working on the wikis below and will post during the week.
- Next release: v2.10.4
+ Next release: v2.10.4[edit]
I'm still waiting on commons / wikidata before doing an English Wikipedia update. I'll work on Hebrew this week and Norwegian / Vietnamese as well.
@@ -979,13 +979,13 @@
For code, I'm going to change tack again and table the article update function. I'm working on a different XOWA Android UI with hopes of updating the alpha in the next few weeks.
- Next release: v2.10.4
+ Next release: v2.10.4[edit]
I'm still waiting on commons / wikidata before doing an English Wikipedia update. I'll work on Hebrew this week and Norwegian / Vietnamese as well.
@@ -1017,13 +1017,13 @@
For code, I'm going to change tack again and table the article update function. I'm working on a different XOWA Android UI with hopes of updating the alpha in the next few weeks.
v2.10.2 is a major release. It has a critical fix for the 2015-10 English Wikipedia dump. It also features better functionality for Chinese / Serbian language wikis. Finally, it also has some significant under-the-hood changes
- Fix for broken references in 2015-10 English Wikipedia dump
+ Fix for broken references in 2015-10 English Wikipedia dump[edit]
XOWA was showing broken references on 2.6 millions pages for the 2015-10 English Wikipedia dump. This was due to some recent changes in Module:Citation/CS1. Specifically, the number of local variables in the citation0 function was greater than the default 200 limit for Luaj.
@@ -1032,7 +1032,7 @@
I recompiled a new version of luaj_xowa.jar to fix this issue.
- Language support for Chinese / Serbian languages
+ Language support for Chinese / Serbian languages[edit]
This item basically involves the following changes:
@@ -1049,31 +1049,31 @@
I'm really hoping that the new functionality matches MediaWiki. If you're a Chinese / Serbian user, please take a moment to spot-check a few pages and let me know if there is anything amiss.
- Better support for <source> and <syntaxhighlight>
+ Better support for <source> and <syntaxhighlight>[edit]
MediaWiki recently changed the <syntaxhighlight> extension away from geshi to Pygments. In the process, it looks like they changed a few of the general parsing rules as well. v2.10.4 has better support for these blocks, though actual syntax coloring is still some time away.
- Full support for interwiki links
+ Full support for interwiki links[edit]
v2.10.2 now incorporates online calls to Wikimedia APIs. The first use was to download a full list of interwiki aliases for each wiki. For those users in offline mode, you can manually generate the list. For more info, see Dev/Design/Site_config
- Support for Dansguardian import filter
+ Support for Dansguardian import filter[edit]
XOWA supports custom creation of wikis by matching articles against words. For example, you can create an English Wikipedia that doesn't have any Pokemon articles. Or you can create an English Wikipedia that just has Pokemon articles. The system is intricate but should be quite powerful. For more info, see App/Xtn/Import/Dansguardian
- More source code cleanup
+ More source code cleanup[edit]
There was a lot of source code cleanup. The process is still ongoing as I'm working on removing old code, as well as rewriting some knottier sections.
- Next release: v2.10.3
+ Next release: v2.10.3[edit]
I didn't have time to generate any wikis this week. I'm going to do English, Serbian and one of Malay, Hebrew, Bulgarian for v2.10.2
@@ -1085,7 +1085,7 @@
I'm skipping the release this week. I ran into some issues with Chinese / Serbian translations, though I think I'm pretty close to being done. In addition, I have some other significant changes in queue which I didn't want to introduce for a "first-week-of-the-month" release.
@@ -1097,25 +1097,25 @@
Otherwise, next week's v2.10.2 will have more changes. I'll also resume generating wikis from the list below.
There is only one change worth more detail. I was using default values for Wikidata date precision which caused Script Error's to show on a few dozen Hungarian pages.
- Image packages for Hungarian and Thai wikis
+ Image packages for Hungarian and Thai wikis[edit]
- Next release: v2.9.4
+ Next release: v2.9.4[edit]
For images, I'm going to work on Serbian, Malay, Hebrew and Bulgarian
@@ -1124,19 +1124,19 @@
For development, I'm going to introduce the the Chinese / Serbian language translation.
v2.9.3 is another light release. It has a few fixes for Chinese wikis.
- Handle new relative urls for CSS
+ Handle new relative urls for CSS[edit]
Wikimedia changed their url format for CSS resources this week. Previously it used to be "//simple.wikipedia.org/w/...". Now it is just "/w/..." Unfortunately, since XOWA didn't handle relative-style urls, the CSS files weren't being downloaded for new wikis. This is fixed now.
- Parser fixes for Chinese wikis
+ Parser fixes for Chinese wikis[edit]
After building the images for the Chinese wikis, I noticed that there were issues with blank message boxes and blank reference text. It turned out that these were broken by the language dropdown back in v2.8.1. I spent a good deal of time fixing these issues, but realized that the current implementation of variant handling (-{zh-hans:text}-) needs to be rewritten.
@@ -1145,7 +1145,7 @@
The current version is much better than the last version, but there are still some changes that need to be done.
- Minor source code reorganization
+ Minor source code reorganization[edit]
I spent a good deal of time reorganizing the main XOWA project codebase. In particular, XOWA had a lot of extra "Source Folders" in addition to "src". These folders arose from the C# to Java conversion and C# having a broader scope for a non-public class than Java (in C#, non-public classes can be seen by classes across namespaces).
@@ -1154,13 +1154,13 @@
Source code cleanup is an ongoing process, but this should make a substantial difference.
- Image packages for Portuguese, Romanian, and Indonesian wikis
+ Image packages for Portuguese, Romanian, and Indonesian wikis[edit]
- Next release: v2.9.4
+ Next release: v2.9.4[edit]
For images, I'm going to work on Hungarian, Thai and Serbian.
@@ -1169,25 +1169,25 @@
For development, I'm going to put the Math parser to the side and work on rewriting the Chinese / Serbian language translation
- Minor parser changes
+ Minor parser changes[edit]
I made a few minor parser changes to handle articles in Romanian, Turkish and Finnish wikis.
- Next release: v2.9.3
+ Next release: v2.9.3[edit]
For images, I'm going to work on Indonesian, Romainian and Portuguese.
@@ -1196,31 +1196,31 @@
For development, I'm still working on the Math parser and some infrastructure items.
MediaWiki recently began incorporating a new Javascript-centric extension for making graphs. They only show up on a few pages, but I wanted to make sure XOWA handled them before they show up on more.
- Removed Mac OS X DMG
+ Removed Mac OS X DMG[edit]
I ended up removing the Mac OS X DMG. The main problem is that future updates (for example v2.9.1) would actually overwrite any existing wikis. I'll reinstate the DMG at a future release, but I'll need to make some XOWA changes to allow customized user wiki folders.
- Updated images for German and Turkish wikis
+ Updated images for German and Turkish wikis[edit]
- Next release: v2.9.2
+ Next release: v2.9.2[edit]
For images, I'm going to work on Chinese, Indonesian and Romainian.
@@ -1229,19 +1229,19 @@
For development, I plan to work on the Math parser and some more infrastructure items.
- Images moved from /user/anonymous/app to /bin/any/xowa/file
+ Images moved from /user/anonymous/app to /bin/any/xowa/file[edit]
I moved all files and images out of the "/user/" file hierarchy. Basically, I'm planning to reduce "/user/" to only a few files or directories. CSS files will probably be moved out within the next few months as well.
- Next release: v2.9.1
+ Next release: v2.9.1[edit]
For images, I'm going to continue image updates with German, Turkish and Indonesian.
@@ -1265,31 +1265,31 @@
For development, I plan to keep v2.9.1 light, so will work on either Android or other long-running items
- Import Wikimedia wikis with non-consistent language (ar.wikimedia.org; br.wikimedia.org)
+ Import Wikimedia wikis with non-consistent language (ar.wikimedia.org; br.wikimedia.org)[edit]
This was reported in https://github.com/gnosygnu/xowa/issues/21 . Basically, there were 7 new Wikimedia wikis with inconsistent language codes. For example, ar.wikimedia.org was not for Arabic Wikimedia, but for Argentinian Wikimedia. Unfortunately, this required some rewrite of the url code as XOWA assumed that the language codes were consistent: for example, "ar." always meant Arabic.
- Minor fixes for Firefox Addon
+ Minor fixes for Firefox Addon[edit]
- Next release: v2.8.5
+ Next release: v2.8.5[edit]
For this week, I'm going to continue image updates with Ukrainian, German and Finnish.
@@ -1298,19 +1298,19 @@
I spent some time on Math parsing this week, and may continue on this for next week. I'll try to work in some Android dev, as the alpha hasn't been updated for 2 months now.
v2.8.3 is a significant release, but mostly from an infrastructure point-of-view. It has several application startup and deployment changes. It also has an update for English Wikipedia 2015-08-05
- English Wikipedia images for 2015-08-05
+ English Wikipedia images for 2015-08-05[edit]
- Application startup changes, including splash animation, fatal error window, and .exe changes
+ Application startup changes, including splash animation, fatal error window, and .exe changes[edit]
v2.8.3 has a number of application startup changes. The most noticeable one is a splash animation to show that XOWA is launching after you double-clicked the exe (or ran the sh).
@@ -1336,7 +1336,7 @@
- XOWA home wiki is now a sqlite3 database
+ XOWA home wiki is now a sqlite3 database[edit]
When v0.0.0 was first released, XOWA used text files for all its wikis. XOWA has since moved to sqlite3 databases in v0.7.1 but the home wiki still remained in the text file format.
@@ -1345,7 +1345,7 @@
With v2.8.3, the home wiki now is in a sqlite3 format. This should be the start of a number of changes, including better namespaces (everything is in the Help namespace), a functioning Search, image support, and overall better editing. Also, the home wiki will soon be part of the Android Alpha app.
- Cleanup of /xowa/ root directory
+ Cleanup of /xowa/ root directory[edit]
v2.8.3 now deploys much fewer files to the /xowa/ root directory. This was done primarily to avoid confusion for new users, as well as general deployment aesthetics. All other files have been moved to elsewhere in the /xowa/bin/xowa/ hierarchy. See the Change Log for more details.
@@ -1354,13 +1354,13 @@
For upgrade users, you can ignore these old files in the /xowa/ root directory or clean them up manually. You can also update your app by regenerating the XOWA root directory. See App/Setup/Upgrading and "Upgrading by an xowa_app package and regenerating the XOWA root directory"
v2.8.3 has one trivial Scribunto fix that caused "Script error" on about a dozen or so pages in English Wikipedia.
- Next release: v2.8.4
+ Next release: v2.8.4[edit]
Now that English Wikipedia images were finally released, I'm going to resume the long overdue backlog. I'm scheduling Ukraine, Persian and Bengali for this week.
@@ -1369,13 +1369,13 @@
I did some Android development this week, and will work on Search support. I'll also work on any issues the new builds turn up, including one outstanding one for broken Math expressions on some pages: https://github.com/gnosygnu/xowa/issues/10
- Minor fixes for file download
+ Minor fixes for file download[edit]
While generating the 2015-07 images, I noticed a bunch of minor file issues. They affect something like 5,000 images (out of 4,000,000). These were fixed in this release, and will show up in the next image update
- Minor fixes for Wikibase
+ Minor fixes for Wikibase[edit]
There were a handful of minor fixes with wikibase, primarily revolving around date.
- Next release: v2.8.3
+ Next release: v2.8.3[edit]
Packages were delayed again this week. Part of this is related to the erratic Wikimedia dump server schedule. The other part was due to the file issues found during the English Wikipedia 2015-07 generation.
@@ -1411,7 +1411,7 @@
I'm going to focus more on packages this week, with English Wikipedia being the main priority. If I have time, I'm going to work on the home database as well as Android.
- Release: Windows 64-bit update (2015-08-03 20:15 Mon)
+ Release: Windows 64-bit update (2015-08-03 20:15 Mon)[edit]
- Language conversion dropdown for Chinese wikis
+ Language conversion dropdown for Chinese wikis[edit]
v2.8.1 now supports the language conversion dropdown for Chinese wikis. This enables users to switch between China, Macau, Malaysia, Singapore and Taiwan conversions for zh.wikipedia.org (as well as other zh.*.org wikis)
@@ -1441,7 +1441,7 @@
Thanks to anonymous4 for reviewing and testing this feature.
- Windows 8.1 support (by downgrading to XULRunner 24)
+ Windows 8.1 support (by downgrading to XULRunner 24)[edit]
There were a few reports with XOWA not working on Windows 8.1. See: https://github.com/gnosygnu/xowa/issues/14 . I don't have a Windows 8.1 box, but it looks like the issues were related to the recent upgrade to XULRunner 31. Although XULRunner 31 works fine on Windows 7 and Windows XP, it looks like it fails on Windows 8.1. I downgraded to XULRunner 24 and it looks like that should fix the issue.
@@ -1450,25 +1450,25 @@
Thanks to anonymous#14 for helping me work through it.
- Fix for incorrect Main_Page in various wikis
+ Fix for incorrect Main_Page in various wikis[edit]
v2.7.2 introduced a bug wherein the Main_Page was incorrectly detected for some wikis. This affected uk.wikisource.org, zh.wikipedia.org, www.wikidata.org and several others. If you've imported a wiki and the wiki doesn't open, please try to import it again with v2.8.1
- Scribunto and Wikibase updates
+ Scribunto and Wikibase updates[edit]
I discovered I accidentally disabled the build warning codes back in February. As a result, a number of minor Scribunto and Wikibase issues accumulated over the past few months. v2.8.1 resolves about 90% of these issues, though there are still a few more to go through.
There were a lot of other minor fixes in v2.8.1. Most of these are parser related, but there are a few interesting items under the change section. Please have a look at the Change_log
- Next release: v2.8.2
+ Next release: v2.8.2[edit]
I delayed packages for another wiki due to all the parser issues (particularly the Wikibase ones). I'm going to resume with images for 2015-07 English Wikipedia as well as the still-delayed Ukraine, Persian and Bengali wikis.
@@ -1477,7 +1477,7 @@
For v2.8.2, I'm going to make yet another attempt at converting the home wiki to a sqlite database. A new Android Alpha is still on the list as well.
I'm skipping the release this week. I'm working on getting the multi-language dropdown for Chinese and Serbian wikis (and any other wikis with variant languages). I ended up rewriting a lot of internal URL logic to support URLs like "zh.wikipedia.org/zh-hans/A" instead of "zh.wikipedia.org/wiki/A". I didn't have much time to work on anything else.
@@ -1486,10 +1486,10 @@
I'll resume work on the other items for 2.8.1.
- Online download sometimes downloads wikis from your.org instead of wikimedia.org
+ Online download sometimes downloads wikis from your.org instead of wikimedia.org[edit]
As per https://github.com/gnosygnu/xowa/issues/7 partial dumps were only importable for time zones west of Greenich Mean Time. v2.7.3.3 fixes it for all time zones.
@@ -1498,10 +1498,10 @@
Yet another thanks to Anselm for working through this issue.
- Online download sometimes downloads wikis from your.org instead of wikimedia.org
+ Online download sometimes downloads wikis from your.org instead of wikimedia.org[edit]
Unfortunately, a change in v2.7.3.1 caused XOWA to download wikis from your.org for partial dumps.
@@ -1510,10 +1510,10 @@
Thanks to Anselm for continuing on this issue.
The old version of the Bookmarks page was a simple feature. It basically added bookmarks to the bottom of a wiki page. Unfortunately, it was part of the "home" wiki and used the old text database format. I needed to convert the home wiki for Android, but couldn't do it without breaking Bookmarks.
@@ -1528,7 +1528,7 @@
Also, many thanks to anonymous4 for assisting with the HTML and CSS.
- Fix for Persian Wiki images
+ Fix for Persian Wiki images[edit]
It turns out that MediaWiki allows pixel sizes in non-English numbers. For example [[File:A.png|۲۰۰px]] means 200px. Unfortunately, XOWA was interpreting this as no-image-size.
@@ -1537,13 +1537,13 @@
v2.7.3 now supports non-English pixel sizes.
- Minor miscellaneous fixes
+ Minor miscellaneous fixes[edit]
There were a bunch of minor fixes. None of these are worth further explanation, so please take a quick look at the Change_log
- New javascript libraries
+ New javascript libraries[edit]
The new Bookmarks page uses more Javascript libraries. This includes jquery-ui for dragging and resizing as well as notifyjs for notification messages. I updated the existing jquery script to the latest version and also changed some of the core xowa ones.
@@ -1552,7 +1552,7 @@
This will probably become more of a future trend. Future GUI features will appear in Javascript rather than SWT. SWT / XULRunner is sometimes finicky cross-platform, and difficult to debug / reproduce. Meanwhile, GUI features implemented in Javascript can easily be used by the XOWA GUI as well as HTTP Server and Android.
- Next release: v2.7.4
+ Next release: v2.7.4[edit]
I decided to wait on Ukraine, Persian and Bengali wikis one week in order to generate 2015-07 versions (instead of 2015-06). I'll be pushing them out over the course of this week. In addition, English Wikipedia should be completing this week, so I'm hoping to get it out as soon as possible. I'll then go on to German, French and Arabic afterwards.
@@ -1561,10 +1561,10 @@
For v2.7.4, I'm going to move on to converting the home wiki to a sqlite database. Once that's done, I'll refresh the Android Alpha and try to add Bookmarks as well as bunch of other features.
- Support for Extended String Functions for non WMF wikis (Wikia, Nethack)
+ Support for Extended String Functions for non WMF wikis (Wikia, Nethack)[edit]
This was noted in this github issue. Some non Wikimedia Foundation wikis such as Wikia wikis and the nethack wiki use extended string functions like {{#replace}}, {{#sub}}, {{#count}}, etc.. I ended up implemented these, as they were not difficult, and they are prevalent in a lot of MediaWiki installations.
- Rewritten HTTP server engine to support POST requests
+ Rewritten HTTP server engine to support POST requests[edit]
First, many thanks again to Mattze96 for the great HTTP server. It's been running fine for a year and a half, and been easy to patch. However, new features were needed for the HTTP server including:
@@ -1624,13 +1624,13 @@
In addition, I fixed a bug with the Timeline javascript. For some reason, it failed in Firefox, but strangely not in XULRunner. Thanks to MDE for reporting it.
- Minor parser changes
+ Minor parser changes[edit]
There were a handful of minor parser changes. The most meaningful was support for the {{gender}} function as well as a fix for coordinates and a bad default value of "http:\\/\\/www.wikidata.org\\/entity\\/Q2".
- Next release: v2.7.3
+ Next release: v2.7.3[edit]
I was tempted to include the new Bookmarks page for v2.7.2, but I wanted to hold off and try to add some features such as bookmark folders and drag-and-drop. Unfortunately it's a blocking task for Android, as it stops me from adding the home wiki to Android. I'm going to try again to get it in for v2.7.3. I'll also work on a refresh of the Android Alpha.
@@ -1639,10 +1639,10 @@
For dumps, I'm in a holding pattern until WMF resumes. See https://lists.wikimedia.org/pipermail/xmldatadumps-l/2015-July/001160.html . I'll try to update Ukrainian, Persian and Bengali as they are quite old, but I'm still holding off on English, German, French and Arabic.
- Upload of English Wikipedia files for Android Alpha
+ Upload of English Wikipedia files for Android Alpha[edit]
I finished uploading the files for English Wikipedia. Note that these files are just like the 2015-04 set, except that the max file size is 1.5 GB instead of 3 GB. Android can't use 3 GB files.
@@ -1657,7 +1657,7 @@
XOWA droid can now run a complete version of English Wikipedia. Of course, I'll be making many more changes in the upcoming months. If you come across any bugs or have any suggestions, feel free to drop by and give me some feedback as per Help/Feedback
- Fixes for CSS generation
+ Fixes for CSS generation[edit]
v2.7.1 fixes some minor CSS generation issues. The main problem was due to Wikimedia replacing http with https. This would have caused new wikis to have blank logos in the upper left hand corner. If you have a blank logo, try the following (using Simple Wikipedia as an example):
@@ -1674,19 +1674,19 @@
- Minor fixes for Firefox Addon
+ Minor fixes for Firefox Addon[edit]
There were some minor Firefox Addon issues that primarily affected Linux versions of Firefox. The most significant one was that the "XOWA Home" button in the toolbar did not work. There were a few other url issues with clicking items in the sidebar.
- Fixes for image database generation
+ Fixes for image database generation[edit]
I tried to resume image database generation this week, but ran into a few snags. I make a handful of fixes to the image db generation.
- Next release: v2.7.2
+ Next release: v2.7.2[edit]
I spent most of the week on infrastructure for a new Bookmarks page that would work across XOWA versions of GUI, HTTP Server and Android. This UI infrastructure should also be the foundation for upcoming changes to the HTTP server as well as a future rewrite of the Options pages. I didn't want to release this for v2.7.1, but I will release it for v2.7.2. I'm also going to work on getting a new build of the Android Alpha with a few minor features.
@@ -1695,10 +1695,10 @@
I fell behind on dumps this weeks. I'm generating Finnish Swedish now, and will be uploading them during the week. Spanish should follow suit afterwards. Unfortunately, the Wikimedia dump servers look like they are having problems, so I may continue with refreshes of Japanese. Once the dumps resolve, I'll work on updates for English, German, French and Arabic.
- Fix for wikis not working because of old image databases
+ Fix for wikis not working because of old image databases[edit]
This was broken during the general database redesign in v2.4.3. XOWA was assuming that v1 image databases would have a format of "fsdb.atr.00.sqlite3". Instead some were "fsdb.atr#00.sqlite3". This only affects image databases from late 2013 and early 2014.
@@ -1733,13 +1733,13 @@
Also, thanks to William for patiently working with me to troubleshoot the issue.
- Release of English Wikipedia text-only version for Android Alpha
+ Release of English Wikipedia text-only version for Android Alpha[edit]
- Addition of Special:XowaDiags for troubleshooting
+ Addition of Special:XowaDiags for troubleshooting[edit]
I created a new Special page for helping with general issues. For example, this will list all files in your English Wikipedia directory: home/wiki/Special:XowaDiag?type=fs.check&wiki=en.wikipedia.org
@@ -1748,7 +1748,7 @@
Right now, it's pretty basic, and will change over the next few releases.
- Next release: v2.7.1
+ Next release: v2.7.1[edit]
I'm going to try to keep the next version stable, so I'll probably only work on XOWA droid items. However, I may add a new Bookmarks page for the HTTP server as well as Android.
@@ -1757,10 +1757,10 @@
For dumps, a lot depends on the Wikimedia dump servers. I'd like to work on German, but would rather wait for an official "July" version. I'll probably rebuild Spanish and Finnish.
- Images not being downloaded due to Wikimedia change from http to https
+ Images not being downloaded due to Wikimedia change from http to https[edit]
As per this blog post, Wikimedia has started moving all traffic to https. Some of this seems to have been implemented during the past week. As a result, XOWA was failing in connections to the Wikimedia servers because it was using http.
@@ -1778,7 +1778,7 @@
For v2.6.4, I updated the links to https. Image downloads (and api calls) now work.
- English Wikipedia image update for 2015-06-02
+ English Wikipedia image update for 2015-06-02[edit]
This was a long time in coming. The last good build was back in April. The main problem was that the dump server had been offline for all of May. There were also some XOWA issues, and I had to patch the new code to handle v2 as well as v1.
@@ -1798,7 +1798,7 @@
v1 is obsolete. I needed to make these changes for Android, as well as to simplify future deployments. I will still generate updates for it for the next year, but users are encourage to move over to a v2 series.
- Next release: v2.6.5
+ Next release: v2.6.5[edit]
I didn't get any of the planned changes done for this week, as both the table of contents and bookmarks were large items. I'm planning to work on them over the next few weeks.
@@ -1810,7 +1810,7 @@
For wikis, I'm going to upload the English Wikipedia HTML databases, and try to get German going as well.
I'm trying something different with blog entries. I'm going to expand upon changes in the current release here, and give a preview of next week's release. I think the prior method was not offering much information. The new way takes more time to write, but hopefully it will be worth it.
@@ -1819,7 +1819,7 @@
With that said, here goes.
- Fix for images sometimes not being shown for v1 users
+ Fix for images sometimes not being shown for v1 users[edit]
v2.5.4 introduced a bug for users with v1 image databases (.sqlite). Here's a possible use case:
@@ -1848,7 +1848,7 @@
If you find your images are still not working, please post as per Help/Feedback
- Mac OS X now defaults to WebKit instead of XULRunner
+ Mac OS X now defaults to WebKit instead of XULRunner[edit]
Mac OS X had two major issues:
@@ -1874,7 +1874,7 @@
I'm still including XULRunner in the Mac OS X app packages for now, though I may end up dropping them entirely in a future release.
- Fixes for highlight-all-words
+ Fixes for highlight-all-words[edit]
v2.5.4 introduced multiple highlights when using the find feature. Unfortunately, there were two bugs I couldn't fix for that release:
@@ -1894,7 +1894,7 @@
The new version is at /xowa/bin/any/xowa/html/res/src/xowa/find/xowa_find_html.js
- Support for Wikidata import by entities
+ Support for Wikidata import by entities[edit]
The wikidata dumps have been delayed for a while. The last good dump was http://dumps.wikimedia.org/wikidatawiki/20150330/ In addition, Wikimedia had an outage in the dump service. See https://phabricator.wikimedia.org/T98585 Dumps have resumed, but it looks like wikidata is queued as one of the last ones.
@@ -1906,13 +1906,13 @@
With this in mind, I wrote some very basic import code to build a wikidata wiki from the JSON dump. It's not perfect, but it allows me to make progress with the image databases. For more info, see: Dev/Command-line/Wikidata
- More improvements for XOWA droid alpha
+ More improvements for XOWA droid alpha[edit]
I've added a number of improvements for the XOWA droid alpha. The last release would not work on Android KitKat, and probably other versions as well. I've since tested on 2 other devices, and got them working. I've also added quite a bunch of other stability changes.
At this point, I'm focusing on uploading an English Wikipedia that can be used for XOWA droid. I'm generating an html dump build now and should have it uploaded in the next week or so. In addition, I'm also going to re-upload the English Wikipedia images as the current v2 batch won't work on Android (they have file sizes greater than 2 GB)
@@ -1949,7 +1949,7 @@
Finally, for image databases, I'm only planning to upload the latest images for 2015-06-02 English Wikipedia. I'll be uploading v2 as well as v1 (.sqlite3)
v2.5.4.1 is a significant release. In brief, it involved a rewrite of the online file downloading system to use the same system as the offline version. It also includes instructions for building the image databases on Dashboard/Image_databases as well as an Android alpha. It may be worthwhile to go through the items in Change_log
@@ -1964,7 +1964,7 @@
The next release will be June 14th. I'm planning to have more Android-related changes, and hopefully resume image database generation.
I'm skipping the release this week. I'm changing the online download mode to go directly to the sqlite databases (instead of #meta), and wanted to have more time to test it.
@@ -1979,13 +1979,13 @@
Also, I'll put up another post later this week for generating image databases.
v2.5.2.1 supports downloading the wiki logo from a new location. The change was serious enough to delay French and Arabic wikis for this week. I'm planning to upload them during the course of this week. I postponed the search change for punctuation as it looks like a significant change, and I didn't want to commit time to it just yet. I also did some work on the Android version.
@@ -1994,7 +1994,7 @@
For v2.5.3, I'm going to work more on the Android alpha. For wikis, I'll not planning anything aside from French and Arabic.
v2.5.1.2 is a fix for Mac OS X users only. Windows / Linux users with v2.5.1.1 can ignore v2.5.1.2. It resolves the problem with the hyperlink clicks being off by 3 pixels down.
@@ -2003,13 +2003,13 @@
Thanks to anonymous4 for picking up the issue so quickly.
- Mac OS X issue (2015-05-04 00:25 Mon)
+ Mac OS X issue (2015-05-04 00:25 Mon)[edit]
It seems that v2.5.1.1 has a regression bug that affects Mac machines only. Basically, all hyperlink clicks would be off by 3 px down. I'll look into it tomorrow and hopefully post a fix for it then.
v2.5.1.1 has a new tabs-interface for the Options page. It also includes a number of thread-related fixes as well as Wikisource related changes. I made some progress with Android and am targeting an alpha release for the smaller wikis this month.
@@ -2021,7 +2021,7 @@
For v2.5.2, I'm planning on a search-related fix to handle punctuation (searching for "don't"). I'm also going to see what I need to release an Android version of Simple wiki to any interested user. For wikis, I will do the French wikis and maybe Arabic (if the latter is problematic, I'll fall back to Latin).
v2.4.4.1 introduces a multi-wiki search feature. The configuration is a bit difficult, but it should be flexible enough to handle most scenarios. See Options/Search. I also made a few more improvements to the general Search behavior. There are also some important incremental fixes from earlier this week.
@@ -2033,7 +2033,7 @@
For v2.5.1, I'm only planning on minor tweaks to search, as well as anything else that comes up. For wikis, I will do the other English wikis as well as Korean.
v2.4.3.1 has some minor cleanup of items from Special:Search. I started working on multi-wiki search, but could not finish it. I also resolved a number of issues including a few around the HTTP server as well as general file retrieval.
@@ -2045,7 +2045,7 @@
For v2.4.4, I'll try to get multi-wiki search included. I also have a number of minor items. For wikis, I will do German as well as Czech.
v2.4.2.1 improves performance for Special:Search. This took quite a bit of time as I had to rewrite most of the search code while also adding new features, such as background searching. There are still a few loose ends, but I believe the new version is much more usable than the old one.
@@ -2057,7 +2057,7 @@
For v2.4.3, I want to clean up some of the loose ends on Special:Search, and also support searching over multiple wikis. I'll also upload Simple, English, Polish and Greek. If I have any leftover time, I'll go back to Android.
v2.4.1.1 introduces new major database layout changes. The main purposes were the following:
@@ -2083,7 +2083,7 @@
For v2.4.2, I'm going to upload English Wiki in the new database layout. They should be up by Saturday at https://archive.org/details/Xowa_enwiki_latest I'll also queue up Polish and Greek afterwards. I'm planning to work on some performance enhancements for Special:Search as well as resume work on Android.
So, I'm going to be skipping this week's release as well. The code is mostly done, but I had to rewrite a significant part last night, so I wanted to give it more time to burn in. Polish and Greek are still on hold, and they will be released after English.
@@ -2092,7 +2092,7 @@
At this point, the new changes will be going live for v2.4.1. It's not ideal, but I'd rather have a more stable major than a possibly unstable minor one.
I'm skipping this week's release also. I've rewritten most of the code, but I wanted another week to do some more testing. I'm also skipping Polish and Greek, as I want to start releasing databases in the new format.
@@ -2101,7 +2101,7 @@
I won't be skipping v2.3.5 as I'd like to introduce the new database layout in a minor release, rather than a major 2.4.1 one.
I'm skipping this week's release. I'm rewriting more of the database code to generate a single-file wiki. I'm also doing the same for files to generate a single-file database. I'm hoping this will help simplify deployment in the future - particularly for Android. The code is stable, but I want a little while longer to review the database scheme. Aside from that, I haven't run into any bugs, so there wouldn't be much point to releasing a work-in-progress.
@@ -2113,7 +2113,7 @@
v2.3.4 will include the new database code. I'm also planning on updating Polish and Greek.
v2.3.2.1 had some minor fixes. The most major fix was Wikisource not showing full content for non-English wikis. Unfortunately this was related to some of the infrastructural changes last week.
@@ -2125,7 +2125,7 @@
v2.3.3.1 will have Finnish wikis as well as the latest English wiki update. I'm also working on a single-file XOWA database. Other than that, I'll continue ahead with Android.
v2.3.1.1 had no real fixes. The Dutch and Latin wikis were rebuilt without any isses, though Latin is still uploading. There were substantial infrastructural changes, though hopefully I won't run into the same release problems from last week. In addition, I finally got a very alpha version of images working on the Android.
@@ -2134,13 +2134,13 @@
v2.3.2.1 will have a rebuild of the Italian and Finnish wikis. I'll continue ahead on Android and try to get a more stable version.
v2.2.4 included some major changes, the most significant of which was the Scribunto error when files were missing. There were also several involving wikidata.org. I made a lot of source code changes, and the version history will probably continue to be very busy for the next few weeks.
@@ -2169,7 +2169,7 @@
v2.3.1 will have a refresh of the Dutch and Latin wikis. I'm also working on getting an Android prototype of simplewiki with images.
I'm skipping the release tonight. I've spent most of the week making a lot of changes to the file retrieval code, and I'd like another week to make sure things are stable. Also, this month's English Wikipedia release looks stable, so I have no real changes to post. I did upload updates for the English Wikipedia wiki as well as for Simple Wiki
@@ -2178,7 +2178,7 @@
v2.2.4 will include the last of the file database changes. I'm also planning on updating a major wiki -- possibly Russian.
v2.2.2 saw a rebuild of the German wikis. I made a number of small parser changes, but otherwise the German wikis were clean. The German Wikipedia update is running late, so it won't be ready until sometime tomorrow. Aside from the German wikis, I also rewrote much of the database code for the file images.
@@ -2187,7 +2187,7 @@
v2.2.3 will be a refresh of English Wiki. There probably won't be any images, as the Wikimedia dump service is behind, and the commonswiki won't be updated. For Android, I'll move on to building a single database that has both wikis and images in it.
v2.2.1 had only a few changes. I generated the remaining English wikis and fixed a few minor related parser errors. In addition, I continued working on some more database code changes. Meanwhile, I decided to table some of the new Scribunto changes until later.
diff --git a/home/wiki/Blog/2015/03.html b/home/wiki/Blog/2015/03.html
index fe6ec0547..e5f36c97a 100644
--- a/home/wiki/Blog/2015/03.html
+++ b/home/wiki/Blog/2015/03.html
@@ -18,7 +18,7 @@
So, I'm going to be skipping this week's release as well. The code is mostly done, but I had to rewrite a significant part last night, so I wanted to give it more time to burn in. Polish and Greek are still on hold, and they will be released after English.
@@ -27,7 +27,7 @@
At this point, the new changes will be going live for v2.4.1. It's not ideal, but I'd rather have a more stable major than a possibly unstable minor one.
I'm skipping this week's release also. I've rewritten most of the code, but I wanted another week to do some more testing. I'm also skipping Polish and Greek, as I want to start releasing databases in the new format.
@@ -36,7 +36,7 @@
I won't be skipping v2.3.5 as I'd like to introduce the new database layout in a minor release, rather than a major 2.4.1 one.
I'm skipping this week's release. I'm rewriting more of the database code to generate a single-file wiki. I'm also doing the same for files to generate a single-file database. I'm hoping this will help simplify deployment in the future - particularly for Android. The code is stable, but I want a little while longer to review the database scheme. Aside from that, I haven't run into any bugs, so there wouldn't be much point to releasing a work-in-progress.
@@ -48,7 +48,7 @@
v2.3.4 will include the new database code. I'm also planning on updating Polish and Greek.
v2.3.2.1 had some minor fixes. The most major fix was Wikisource not showing full content for non-English wikis. Unfortunately this was related to some of the infrastructural changes last week.
@@ -60,7 +60,7 @@
v2.3.3.1 will have Finnish wikis as well as the latest English wiki update. I'm also working on a single-file XOWA database. Other than that, I'll continue ahead with Android.
v2.3.1.1 had no real fixes. The Dutch and Latin wikis were rebuilt without any isses, though Latin is still uploading. There were substantial infrastructural changes, though hopefully I won't run into the same release problems from last week. In addition, I finally got a very alpha version of images working on the Android.
diff --git a/home/wiki/Blog/2016-01.html b/home/wiki/Blog/2016-01.html
index d8087fb8b..310b761b6 100644
--- a/home/wiki/Blog/2016-01.html
+++ b/home/wiki/Blog/2016-01.html
@@ -25,13 +25,13 @@
The desktop app is a major release. It resolves reference errors in 2016-01 English Wikipedia, fixes wide images on German Wikipedia, and adds a new PageBanner extension
@@ -188,7 +188,7 @@
The Android app is also a major release. It shows more tables, heiroglyphics, and images with a ? in title.
- Luaj fixes for references in 2016-01-13 English Wikipedia
+ Luaj fixes for references in 2016-01-13 English Wikipedia[edit]
The 2016-01-13 dump had many erros in the reference section due to bugs in Luaj. One of the following would be displayed:
@@ -205,7 +205,7 @@
These were bugs in Luaj with the frontier pattern and multi-byte chars. They were both resolved in this release.
- Fix for German Wikipedia and extremely wide pie charts
+ Fix for German Wikipedia and extremely wide pie charts[edit]
I'm extremely thankful for this report at https://github.com/gnosygnu/xowa/issues/38 There were HTML issues in German Wikipedia because all the wikis rely implicitly on American formatting rules for decimals. For example:
@@ -238,13 +238,13 @@
v3.1.5 fixes this issue by asserting that all decimal-parsing is done in the US locale.
- New PageBanner extension for Wikivoyage
+ New PageBanner extension for Wikivoyage[edit]
This was an extension introduced by Wikimedia late last year to standardize the display of the image, icons and table of contents at the top of the page. This involved some considerable work on my side (including a Mustache parser), but XOWA now reproduces the same look.
- (Android) Show navboxes and other tables
+ (Android) Show navboxes and other tables[edit]
The Wikipedia Mobile app deliberately hides navboxes as well as other tables. I think this is done for the following reasons:
@@ -261,7 +261,7 @@
In contrast, I really do like showing as much content as possible, so I decided to show these tables. I'll probably put an option to disable this later, but I'm going to wait first for some feedback from others
- (Android) Always center table content
+ (Android) Always center table content[edit]
This is another deviation from the Wikipedia Mobile app style. Basically most tables are left-aligned and would end before reaching the right-hand side of the page. I changed the CSS to have these tables fill up the entire page and center the content.
@@ -270,19 +270,19 @@
This has one unfortunate sideback in that it breaks the "Collapse" buttons. I'll try to fix this in a future release, but if I can't, I may remove them entirely.
- (Android) Show hieroglyphics
+ (Android) Show hieroglyphics[edit]
The early versions of the XOWA Android app did not show hieroglyphics. This is now supported in this build
- (Android) Show images with ? in file title
+ (Android) Show images with ? in file title[edit]
This was a bug wherein images that had a ? were not being displayed within the Android WebView. I fixed this by replacing ? with %3F.
- Next release: v3.2.1
+ Next release: v3.2.1[edit]
I ran into several issues with the 2016-01 English Wikipedia dump that set me back a few days. I'm planning to upload English Wikipedia images and HTML this week, and then continue on with the other English wikis
@@ -291,13 +291,13 @@
For code, I'm going to tackle performance on the Android search again as well as a few minor UI issues on Android (collapse-table, pinch-zoom)
This is an interim release for the desktop app. It fixes script error messages in 2016-01-13 English Wikipedia
- Scribunto fixes for 2016-01-13 English Wikipedia
+ Scribunto fixes for 2016-01-13 English Wikipedia[edit]
I accidentally had the wrong dump in place when kicking off the 2016-01-13 build. As such, I didn't spot the issue till this morning after I restarted the build.
@@ -309,7 +309,7 @@
v3.1.4.2 resolves both issues. So far, it's stable across 35,000+ pages, but if you run across any issues, please report them. Thanks.
The desktop app is a major release. It resolves several wiktionary errors on non-English pages and has better HTML dump generation for other wikis.
@@ -318,7 +318,7 @@
The Android app is a major release. It has a more responsive search, instant image loading when reloading page, and a fix for pages failing to load if they have spaces and colons in the title.
- Scribunto / Luaj fixes for English Wiktionary
+ Scribunto / Luaj fixes for English Wiktionary[edit]
There were several dozen pages with script errors in English Wiktionary. They basically fell into these categories:
@@ -343,13 +343,13 @@
The build log for English Wiktionary looks a lot cleaner now, though I still have to add some support for the {{categorytree}} function.
- Better HTML dump generation for English Wiktionary, Wikisource, Wikiquote, etc. Also, French Wikipedia
+ Better HTML dump generation for English Wiktionary, Wikisource, Wikiquote, etc. Also, French Wikipedia[edit]
I ran the HTML dump generator through all the English wikis, as well as French Wikipedia. The results looked good, but there were a lot of log errors that were addressed with this release.
- (Android) More responsive search
+ (Android) More responsive search[edit]
Search is still slow on Android. I'll fix this in a future relase, but I'll have to change the format of the search databases.
@@ -369,7 +369,7 @@
- (Android) Instant image loading when reloading page
+ (Android) Instant image loading when reloading page[edit]
First, some background. XOWA loads pages in two stages:
@@ -389,13 +389,13 @@
However, once a page is viewed, reloading a page shouldn't have to re-retrieve the image from the database. The previous releases were actually re-retrieving the image. This release just uses the image if it's already there.
- (Android) Fix for pages failing to load if they have spaces and colons in the title
+ (Android) Fix for pages failing to load if they have spaces and colons in the title[edit]
This only affects a small minority of items that have a colon and spaces in the title. For example, "List of A:B items". XOWA didn't load this page because the underlying Wikipedia Mobile App was encoding the spaces as +.
- Next release: v3.1.5
+ Next release: v3.1.5[edit]
I haven't uploaded wikis this week, because I'm working on a blocking item in Wikivoyage (Pagebanner). I'm going to delay another week and focus on updating 2016-01-13 English Wikipedia. This means a new HTML dump which should be available by next Sunday. I'm also hoping to upload the other English wikis, and then continue on to French, etc.
@@ -407,7 +407,7 @@
Finally, if you have an Android device and want a wiki for your device, let me know which, and I'll bump it up in priority. The next items in queue are French, German, Chinese and Arabic Wikipedia. I'll get to all the wikis but it may take a few months unless I hear requests otherwise.
The desktop app is a trivial release. Its main feature is a help page for generating HTML-dumps
@@ -416,13 +416,13 @@
The Android app is a major release. It has a Random feature, shows more images, and adds CSS-tweaks.
This item is self-explanatory. The XOWA Android app is getting more stable, so I felt it would be time to document the generation of the HTML databases.
- Next release: v3.1.4
+ Next release: v3.1.4[edit]
The Wikimedia dump service resumed, but I'd like to delay French, Polish and Latin for another week. I'm planning to generate HTML dumps for the rest of the English wikis including Wiktionary, Wikisource, Wikivoyage, etc. This will be a good stress test for the new XOWA html-dump format before I continue on to other wikis.
@@ -451,7 +451,7 @@
I'm also going to continue tweaking the XOWA Android app. If you have a moment to help out with testing, please set it up and give me some feedback: https://github.com/gnosygnu/xowa/issues/36
There's no release for the XOWA app tonight. I've spent the week mostly on the Android app, and there were no real changes for the main desktop app.
@@ -477,7 +477,7 @@
If you have Android KitKat or higher and would like to run XOWA on it, I'd be greatly interested in feedback. See the Android progress thread for more details.
- Next release: v3.1.3
+ Next release: v3.1.3[edit]
I still have some tasks for XOWA Android that I'd like to work on this week. I am going to try to release the main app next week, but if there are no new changes it may slip again in favor of an update of the XOWA Android release
@@ -486,19 +486,19 @@
I haven't generated any wikis this week as the dump service seems to have come to a halt. Whenever it resumes, I'll pick up again with the promised updates of French, Polish and Greek
I only saw this issue on one page in English Wikipedia (United Kingdom), but it has potential for more effects. Basically, XOWA did not handle <ref> inside a {{#tag}}. For example: {{#tag:ref|<ref>a</ref>}}. For the United Kingdom page, this threw off the format, and made the Infobox as wide as the entire page.
- Fix for incorrect search word counts and IPA links
+ Fix for incorrect search word counts and IPA links[edit]
There was a minor issue with incorrect search counts for words. I don't think this affects anything for desktop searches, but it did throw off the Android search.
@@ -507,7 +507,7 @@
Meanwhile, due to incorrect URL generation, IPA links would not download from the web after being clicked.
- Trivial HTML changes
+ Trivial HTML changes[edit]
v3.1.1 has a bunch of HTML changes to make it slightly closer to MediaWiki's HTML.
@@ -524,7 +524,7 @@
- Next release: v3.1.2
+ Next release: v3.1.2[edit]
I was on track to release the new Android version tonight, but ran into a last minute issue with thumbs and English Wikipedia. I'm pushing this out another week.
diff --git a/home/wiki/Blog/2016-02.html b/home/wiki/Blog/2016-02.html
index 772d605ef..8a206d339 100644
--- a/home/wiki/Blog/2016-02.html
+++ b/home/wiki/Blog/2016-02.html
@@ -25,13 +25,13 @@
Another week, another postponement. My apologies, but I'm usually very cautious when making database changes -- especially since it's pretty important to get things right the first time. I'm going to try for a Thursday release, but may fall back on next Sunday.
@@ -124,7 +124,7 @@
I did upload the new Android English Wikipedia for 2016-02 this week. The new urls are at https://github.com/gnosygnu/xowa/issues/36#issuecomment-172428070 .
I'm skipping the release this week also. I've made some good progress with search, and have a prototype that is significantly faster than the existing version. However, it'll take me another week before I add it to Android and probably two weeks before the desktop.
@@ -147,7 +147,7 @@
Until then, if you're using the Android beta, please bear with the slow search. Thanks.
I'm skipping the release this week. I'm trying to make a lot of performance-related changes to Search that will affect the desktop and Android version. There's a chance I may skip next week also.
@@ -156,22 +156,22 @@
Also, I'm building English Wiki 2016-02 now. I'm still a little behind in wiki dumps and I'll resume this week.
- Fix for English Wiktionary sections not expanding correctly
+ Fix for English Wiktionary sections not expanding correctly[edit]
This bug occurs when opening up any English Wiktionary page. Each page will have Translation tables with a "Hide" / "Show" button. The following occurred when viewing these pages (for example: https://en.wiktionary.org/wiki/green)
@@ -214,7 +214,7 @@
v3.2.1 now expands these tables by default. Note that you can control the default behavior at Options/Wiki_HTML under Collapsible
- New Raspberry Pi build
+ New Raspberry Pi build[edit]
This build was made possible by yonisolo. Many thanks to him for taking the initiative to get this to work. As a result of his efforts, you can now use your Raspberry Pi to run XOWA as an HTTP server.
@@ -223,13 +223,13 @@
Note that the GUI does not work due to SWT issues with ARM. I don't know if anyone is interested in having this work, but if so, let me know, and I'll revisit.
- Android (No release)
+ Android (No release)[edit]
I'm skipping an Android release this week. I added only one-change (pinch-zoom and bottom panels), and it didn't seem worth a release.
- Next release: v3.2.2
+ Next release: v3.2.2[edit]
I was planning to improve the Android search version this week, but ended up spending some time on the English Wiki builds as well as underlying database code.
diff --git a/home/wiki/Blog/2016-03.html b/home/wiki/Blog/2016-03.html
index a14c6e1f7..77c44cf82 100644
--- a/home/wiki/Blog/2016-03.html
+++ b/home/wiki/Blog/2016-03.html
@@ -25,13 +25,13 @@
The desktop app is a major release. It has a new autocomplete address bar, a new search system as well as minor parser fixes.
@@ -118,7 +118,7 @@
The Android app is a major release. It has more updates for the new search system.
- (Desktop) New autocomplete address bar
+ (Desktop) New autocomplete address bar[edit]
The address bar now supports autocompletion. For example, open up English Wikipedia, and start typing earth. The autocomplete is very fast and supports a lot of advanced functionality. For example you can do a search like earth + (history, future) -middle directly in the address bar. See App/Search as well as Options/Search suggest.
@@ -171,7 +171,7 @@
- (Desktop) New search system
+ (Desktop) New search system[edit]
I completely rewrote the search system over the past several weeks. Most of these changes were meant for Android to handle fast searches with a slower processor. This new engine is now part of the desktop app, so desktop users get the same benefits as well. To summarize, here are the main benefits:
@@ -194,7 +194,7 @@
- (Desktop) Minor fixes for Category pages and taxonomy url links
+ (Desktop) Minor fixes for Category pages and taxonomy url links[edit]
There are basically two fixes:
@@ -208,7 +208,7 @@
- (Android) Improvements for search system
+ (Android) Improvements for search system[edit]
The Android search system received more performance and accuracy improvements. Also, the Android version supports boolean searches as well. If you're using the new search system, you should definitely update your copy:
@@ -225,7 +225,7 @@
If you haven't tried XOWA on Android, please give it a try. See https://github.com/gnosygnu/xowa/wiki/Android.
- Next release: v3.4.1
+ Next release: v3.4.1[edit]
I've spent a lot of time on the search system for the past several weeks. I'm going to take a break and work on the following items for next week's release:
@@ -242,7 +242,7 @@
I'm postponing this week's release. I'm almost done with the desktop integration of the new search system, but I still want to make a few more changes and feel that a few more days would help.
@@ -254,7 +254,7 @@
I'll try to upload a new Android release later this week. This will mostly have small tweaks for the new search system.
Again, there is no new release for the desktop app. I will make one next week, and resume wiki generation then.
@@ -311,7 +311,7 @@
Again, I strongly recommend you get this version. There are a few bugs to work out, but this version is much improved over previous ones. This is the last major update for Android search, and future changes will probably not have as much of a noticeable impact -- at least until I get around to full-text search.
There is no new release for the desktop app. I'm still making major changes to the Search system and need more time for review.
diff --git a/home/wiki/Blog/2016-04.html b/home/wiki/Blog/2016-04.html
index 07e7611c2..04d2d7b93 100644
--- a/home/wiki/Blog/2016-04.html
+++ b/home/wiki/Blog/2016-04.html
@@ -25,13 +25,13 @@
The desktop app is a trivial release. It has a few minor parser fixes, primarily for German Wikipedia.
@@ -175,7 +175,7 @@
The Android app is a minor release. It has one significant fix for not requiring one database: file-xowa. This will only be necessary for the German wikis
- (Android) Fix for missing file-user.xowa database
+ (Android) Fix for missing file-user.xowa database[edit]
The Android app would crash if it was missing this database: *-file-user.xowa. See https://github.com/gnosygnu/xowa/issues/36#issuecomment-172292021 .
@@ -250,13 +250,13 @@
v3.4.4 still tries to create the file-user.xowa file, but no longer crashes if it can't.
- (Desktop) Minor parser changes and fixes, including using non-ASCII strings for gsub find
+ (Desktop) Minor parser changes and fixes, including using non-ASCII strings for gsub find[edit]
These are a bunch of minor parser fixes for German Wikipedia. They affect a small number of pages (<100) and don't affect content. The most interesting item is that it required another change to LuaJ. It mistakenly disregarded UTF8 byte encoding for bytes between 128 and 255. This caused gsub and similar calls to fail when using non-ASCII characters, like "ß"
- Next release: v3.5.1
+ Next release: v3.5.1[edit]
I'm working on a new wiki update tool which will make setting up the databases much easier on Android.
@@ -268,7 +268,7 @@
The desktop app is a minor release. It has various minor fixes, including broken Portal pages and a missing Wikis sidebar
@@ -277,7 +277,7 @@
The Android app is a major release. It has support for Kit-Kat. In addition, it has finally been released to the Play Store!
- (Android) XOWA Android app on Play Store
+ (Android) XOWA Android app on Play Store[edit]
The XOWA Android app has finally been released to the Play Store. Surprisingly, this involved a lot of unforeseen tasks, like graphic design, video recording, icon generation, secure signing, etc. Many thanks to anonymous4 for invaluable help, feedback and support.
@@ -300,7 +300,7 @@
Finally, if you've been using any of the earlier Android App versions, I recommend you update to this version. It only has more UI tweaks in terms of the icons and Settings page, but it is the official release version.
- (Android) Kit-Kat support for Android app
+ (Android) Kit-Kat support for Android app[edit]
The other major item in the Android app release is support for Kit-Kat. This too was made possible by anonymous4 and provision of a Kit-Kat device.
@@ -309,7 +309,7 @@
If you have a Kit-Kat device, please give it a try.
- (Desktop) Minor changes and fixes, including missing random sub-pages in Portal, missing Wikis sidebar in home wiki and no {{DisplayTitle}}
+ (Desktop) Minor changes and fixes, including missing random sub-pages in Portal, missing Wikis sidebar in home wiki and no {{DisplayTitle}}[edit]
v3.4.2.1 has a number of minor fixes. In brief:
@@ -332,7 +332,7 @@
- Next release: v3.4.4
+ Next release: v3.4.4[edit]
I ran into a minor parser issue with Luaj that ended up pushing German Wikipedia back a week. I'll upload an update this week, along with Android wikis.
@@ -359,7 +359,7 @@
- Patch: Missing wikis in sidebar (2016-04-13 21:34 Wed)
+ Patch: Missing wikis in sidebar (2016-04-13 21:34 Wed)[edit]
This is a patch for a defect in v3.4.2.1.
@@ -392,7 +392,7 @@
"]:>
The desktop app is a minor release. It has a fix for slow search database builds and some better Wikia support
@@ -401,7 +401,7 @@
The Android app is a major release. It has new pages for importing a wiki. It is the release candidate for XOWA beta on Google Play later this week.
As per https://github.com/gnosygnu/xowa/issues/53 William was unable to build the new search databases on his machine. I tried it on an older dev machine, and found that it could take upwards of 5 hours to complete.
@@ -429,7 +429,7 @@
- (Desktop) New English Wikipedia images update (2016-03)
+ (Desktop) New English Wikipedia images update (2016-03)[edit]
I uploaded new consolidated versions of English Wikipedia images (2016-03) to archive.org. See https://archive.org/details/Xowa_enwiki_latest.
@@ -452,13 +452,13 @@
Finally, after I release XOWA Beta for Android, I'm going to work on a new update feature that will more gracefully handle monthly updates. In the meantime, please bear with the manual process.
- (Desktop) Minor Wikia parser tags
+ (Desktop) Minor Wikia parser tags[edit]
- (Android) New pages for "Import new wiki" and "XOWA Wikis"
+ (Android) New pages for "Import new wiki" and "XOWA Wikis"[edit]
The last major piece for XOWA Beta was more usable screens for importing wikis and managing wikis. Both these pages are now part of the latest release:
@@ -472,7 +472,7 @@
- (Android) Minor fixes for crashes / obsoleted items
+ (Android) Minor fixes for crashes / obsoleted items[edit]
There were two minor crashes that would occur when using the left-nav button. The main one was pressing "Random" when on the "Import" screen
@@ -481,7 +481,7 @@
I also removed two features: "Nearby" and "Log in to Wikipedia". Neither of these seem useful for offline XOWA, and I didn't want them taking up screen real-estate.
- Next release: v3.4.3
+ Next release: v3.4.3[edit]
I'm planning on releasing XOWA Android Beta on Google Play mid-week. I'm sure that there will be spillover work that leads to another Android app update next week.
@@ -493,7 +493,7 @@
The desktop app is a minor release. It has a few fixes related to old .sqlite3 wikis and offline imports.
@@ -502,7 +502,7 @@
The Android app has not been changed.
- (Desktop) Fixes for old .sqlite3 wikis
+ (Desktop) Fixes for old .sqlite3 wikis[edit]
- (Desktop) Command to shrink English Wikipedia images by 8 GB
+ (Desktop) Command to shrink English Wikipedia images by 8 GB[edit]
The total size of English Wikipedia is about 90 GB. 8 GB is from old images: images removed from articles during the day-to-day editing churn.
@@ -537,13 +537,13 @@
If you have English Wikipedia and have been following along with the updates, go to Dashboard/Files/Deletion and follow the instructions therein.
- (Package) Release of French Wikipedia 2016-03
+ (Package) Release of French Wikipedia 2016-03[edit]
Sory all. I'm postponing the release for tomorrow night. I'll post again tomorrow evening. Thanks.
diff --git a/home/wiki/Blog/2016-05.html b/home/wiki/Blog/2016-05.html
index 80da54327..8a9883d47 100644
--- a/home/wiki/Blog/2016-05.html
+++ b/home/wiki/Blog/2016-05.html
@@ -25,13 +25,13 @@
- Dev: Handling the 1 MB limit for SQLite on Android (2016-05-30 21:15 Mon)
+ Dev: Handling the 1 MB limit for SQLite on Android (2016-05-30 21:15 Mon)[edit]
I rediscovered an unintuitive bug today, and decided to take some time to document it.
@@ -262,7 +262,7 @@ INSERT INTO blob_table (blob_id, blob_column) VALUES (1, '0123456789...'); -- ..
This week is also a no show for releases. I'm planning to make a release next week to handle a few parser issues. I'm also going to try to have the desktop app start reading the HTML databases.
@@ -274,13 +274,13 @@ INSERT INTO blob_table (blob_id, blob_column) VALUES (1, '0123456789...'); -- ..
Thanks.
I'm skipping the release again. I had to overhaul some of the internals of the downloader which cost me a couple of days. I'm not sure if I can get it ready for next week, so it may be a June release.
@@ -289,19 +289,19 @@ INSERT INTO blob_table (blob_id, blob_column) VALUES (1, '0123456789...'); -- ..
I did upload the images for English Wikipedia: https://archive.org/download/Xowa_enwiki_latest/Xowa_enwiki_2016-05-01_file_v2b.7z . I started uploading the Android html version, but ran into an issue with archive.org. You can start downloading the 2016-05 html files now: https://archive.org/download/Xowa_enwiki_latest . I'll upload the rest during the week.
This week is another skipped release, as the work continues on the wiki download page. In the meantime, I'm generating 2016-May English Wikipedia and will have them uploaded this week.
The desktop app is a trivial release. It has a few minor parser fixes, primarily for English Wiktionary.
@@ -310,13 +310,13 @@ INSERT INTO blob_table (blob_id, blob_column) VALUES (1, '0123456789...'); -- ..
The Android app has no release.
- (Desktop) Minor parser fixes for English Wiktionary
+ (Desktop) Minor parser fixes for English Wiktionary[edit]
There are several minor parser fixes for English Wiktionary. The most major item is a simple implementation for {{categorytree}} which will show a link to the Category page, but not do the Javascript tree expansion.
- Next release: v3.5.2
+ Next release: v3.5.2[edit]
I'm still working on the wiki update tool. My goal is to have it for Android v3.5.2. Once that is done, I'll upload the next batch of wikis after it (English / French).
diff --git a/home/wiki/Blog/2016-06.html b/home/wiki/Blog/2016-06.html
index 5918e9537..d360a8a89 100644
--- a/home/wiki/Blog/2016-06.html
+++ b/home/wiki/Blog/2016-06.html
@@ -25,13 +25,13 @@
- (PC) Fix Download Central failing on last step of image import
+ (PC) Fix Download Central failing on last step of image import[edit]
This is a patch to fix an issue with Download Central. Download Central would fail when trying to import images (it failed on the very last command). Restarting the app and resuming would fix it.
@@ -188,19 +188,19 @@
I also included a few minor HTML changes for some related screens.
All apps are a major release due to fixes for Download Central and HTML databases. In addition, both PC and Android now have redlinks.
- (Wiki) 2016-06 English Wiktionary, Wikisource, Wikivoyage, Wikiquote, Wikibooks, Wikiversity, Wikinews and Species Wiki
+ (Wiki) 2016-06 English Wiktionary, Wikisource, Wikivoyage, Wikiquote, Wikibooks, Wikiversity, Wikinews and Species Wiki[edit]
All English wikis are now available for Android as well as desktop (HTML dumps). To download them, go to Download Central.
- (All) Fixes / changes for Download Central including multiple-tasks bug
+ (All) Fixes / changes for Download Central including multiple-tasks bug[edit]
Last week had a patch to handle Download Central not working after resume.
@@ -223,7 +223,7 @@
- (All) HTML Databases: Better support for Redlinks, Timeline and Gallery
+ (All) HTML Databases: Better support for Redlinks, Timeline and Gallery[edit]
Last week had a few patches to handle HTML databases not working for old archive.org wikis.
@@ -243,7 +243,7 @@
- (PC) Minor parser fixes including tags with apostrophe and missing transluded pages
+ (PC) Minor parser fixes including tags with apostrophe and missing transluded pages[edit]
There are a handful of fixes here:
@@ -263,7 +263,7 @@
Unfortunately, parser bugs are still part of the HTML dumps in the 2016-06 versions. They will be fixed in 2016-07 and beyond.
- Next release: v3.7.1
+ Next release: v3.7.1[edit]
- (Server) Fix blank pages for wikis downloaded from archive.org (fixed for GUI in 3.6.3.3, but not for HTTP Server)
+ (Server) Fix blank pages for wikis downloaded from archive.org (fixed for GUI in 3.6.3.3, but not for HTTP Server)[edit]
Thombles reported that v3.6.3.3 still didn't fix the blank pages. See: https://github.com/gnosygnu/xowa/issues/60
@@ -301,7 +301,7 @@
Thanks again to thombles for reporting the issues.
Sorry all. Another patch release to fix a few major bugs.
@@ -310,7 +310,7 @@
Thanks to William and thombles for reporting the issues.
- (PC) Fix blank pages for wikis downloaded from archive.org
+ (PC) Fix blank pages for wikis downloaded from archive.org[edit]
v3.6.3.1 introduced automatic support for wikis downloaded through Download Central (HTML dumps). However, it wouldn't work with any wiki that was downloaded from archive.org (wikitext dumps, but with HTML metadata)
@@ -322,7 +322,7 @@
Also, note that you can disable the automatic HTML read by going to Options/HTML_databases
- (PC) Fix Download Central icons for Mac OS X
+ (PC) Fix Download Central icons for Mac OS X[edit]
Download Central looked pretty bad on Mac OS X. This was due to issues with the CSS flex directive and Safari browsers.
@@ -331,7 +331,7 @@
I put in a fix now to make it more presentable though there are still a few more blemishes to remove.
- (PC) Log Download Central progress to troubleshoot failed completions
+ (PC) Log Download Central progress to troubleshoot failed completions[edit]
I had a report of Download Central failing for Simple Wikipedia. I was able to reproduce it partially on my Windows 32-bit machine, but it has since worked fine 4 times. Note that Download Central has also worked fine multiple times on Windows 64-bit machines and Linux 32-bit machines as well as Android OS.
@@ -340,10 +340,10 @@
I added some logging statements to troubleshoot the issue.
- (PC & Android) Fix Download Central not resuming after app is restarted
+ (PC & Android) Fix Download Central not resuming after app is restarted[edit]
There was a bug in last night's release. Download Central would not resume after restarting the app.
@@ -352,7 +352,7 @@
This is fixed in this release. If you're downloading, please pause the download, exit the app, install the update, and resume again.
The PC app is a major release. It has a new Download page, can now read Android HTML databases by default, and includes many minor fixes
@@ -364,7 +364,7 @@
The Server app is a major release. It can read Android HTML databases by default, and has a fix for the broken Search.
- (PC & Android) New Download Central to download HTML dumps and images
+ (PC & Android) New Download Central to download HTML dumps and images[edit]
Download Central is the major feature of the release. This is an in-app downloader that can download wikis for both Android or desktop. It can download images as well.
@@ -379,7 +379,7 @@
To try it out, go to Download Central. For more info, see the Download Central help page.
- (PC & Server) Android HTML dumps are now usable
+ (PC & Server) Android HTML dumps are now usable[edit]
This is the other major feature of the release. Previously, the app could only read wikitext dumps. Now, it can read the XOWA Android HTML dumps. This has a few key benefits:
@@ -437,7 +437,7 @@
- Requires separate post-processing generation step: The wikitext dumps were automatically generated by downloading an XML dump. The HTML dumps requires another post-processing step that is not simple to run (See: Dev/Command-line/Dumps)
+ Requires separate post-processing generation step: The wikitext dumps were automatically generated by downloading an XML dump. The HTML dumps requires another post-processing step that is not simple to run (See: Dev/Command-line/Dumps)
@@ -460,7 +460,7 @@
- (PC & Android & Server) Search now reduces importance of short pages
+ (PC & Android & Server) Search now reduces importance of short pages[edit]
The new XOWA Search Engine uses PageRank to rate pages by importance. Although this works well for Wikipedia, it sometimes overrates pages which exist for encyclopedic book-keeping.
@@ -472,13 +472,13 @@
v3.6.3 tries to reduce the importance of these pages if these articles are "short". This heuristic was already present in the previous versions of the search engine, but has been further tweaked.
- (Server) Fix for broken Search
+ (Server) Fix for broken Search[edit]
This was kindly reported by thombles here: https://github.com/gnosygnu/xowa/issues/59 . The new Search Engine in 2016-03 broke the HTTP Server search. This was fixed in this release.
- (PC) Minor fixes (Database, HTML Dump, Search, Special, Parser)
+ (PC) Minor fixes (Database, HTML Dump, Search, Special, Parser)[edit]
These can be described briefly as follows:
@@ -501,7 +501,7 @@
- (Android) Minor changes (more Special pages: redesigned UI for special pages, HTML Page Title, flat icon)
+ (Android) Minor changes (more Special pages: redesigned UI for special pages, HTML Page Title, flat icon)[edit]
These can also be described briefly as follows:
@@ -529,7 +529,7 @@
- (Wikis) English Wikipedia (2016-06) and Simple Wikipedia (2016-06)
+ (Wikis) English Wikipedia (2016-06) and Simple Wikipedia (2016-06)[edit]
- Next release: v3.6.4
+ Next release: v3.6.4[edit]
I'm focusing on HTML dump related issues for the next few weeks, particularly table of contents and redlinks
@@ -547,7 +547,7 @@
For wikis, I'm going to update the generate the other English wikis for Download Central.
- Release: Android Beta with wiki downloader (2016-06-12 23:00 Sun)
+ Release: Android Beta with wiki downloader (2016-06-12 23:00 Sun)[edit]
I released a beta version of the wiki downloader: See https://play.google.com/store/apps/details?id=org.xowa.beta and https://github.com/gnosygnu/xowa/releases . I'm planning on doing some minor tweaks this week, before uploading it to the main XOWA Android app next week. I'll also release the desktop app as well.
@@ -556,7 +556,7 @@
In addition, I generated 2016-06 English Wikipedia, and will be uploading a new version to be used with the wiki downloader. Once I get the wiki downloader stabilized, I'll start updating the other wikis.
There's no release again this week. I've been bogged down in Android SQLite optimizations for the wiki downloader. I'm going to release something next week as I'd like to get back to regular releases.
diff --git a/home/wiki/Blog/2016-07.html b/home/wiki/Blog/2016-07.html
index 6566cff97..fb5a54c0d 100644
--- a/home/wiki/Blog/2016-07.html
+++ b/home/wiki/Blog/2016-07.html
@@ -25,13 +25,13 @@
The PC version is a minor release. It fixes a build issue when building wikis from old dumps by command-line script.
@@ -183,7 +183,7 @@
The Android version is a major release. It has a new screen to change the wiki location for Download Central
- (Wiki) Publish 2016-07 English Wikipedia
+ (Wiki) Publish 2016-07 English Wikipedia[edit]
The 2016-07 versions of English Wikipedia is up. You can get them through Download Central.
@@ -208,7 +208,7 @@
- (Android) Add screen to change wiki location for Download Central
+ (Android) Add screen to change wiki location for Download Central[edit]
First, some background. XOWA Android tries to use the external SD card for downloading wikis. Unfortunately, this is not easy, as different devices may have different paths for the external SD card (it varies by Android version as well as by manufacturer). If XOWA doesn't guess correctly, then the wikis will be downloaded to internal memory
@@ -226,7 +226,7 @@
Note that you can always manually download the wiki from archive.org and import them using the "XOWA file browser". The "XOWA file browser" is available through the "folder" icon on the "XOWA" Wikis page.
- (PC) Fix automatic deletion of pagelinks file
+ (PC) Fix automatic deletion of pagelinks file[edit]
This was a minor bug with building wikis by command-line import for historical wikis (for example, English Wikipedia from 2016-01).
@@ -241,7 +241,7 @@
v3.7.4 now only deletes .gz file after it is used.
- Next release: v3.8.1
+ Next release: v3.8.1[edit]
The PC version is a major release. It fixes redirects for HTML databases and minor TOC issues.
@@ -273,13 +273,13 @@
The Android version has no release.
- (Wiki) Publish 2016-07 French Wikipedia, Wiktionary, Wikisource, Wikivoyage, Wikiquote, Wikibooks, Wikiversity, and Wikinews
+ (Wiki) Publish 2016-07 French Wikipedia, Wiktionary, Wikisource, Wikivoyage, Wikiquote, Wikibooks, Wikiversity, and Wikinews[edit]
The 2016-07 versions of the French Wikis are up. You can get them through Download Central.
- (PC) Fix Redirects not working for HTML databases
+ (PC) Fix Redirects not working for HTML databases[edit]
I discovered that HTML databases didn't support redirects. So, if page "A" was a redirect to page "B", going to page "A" opened up a blank page.
@@ -288,7 +288,7 @@
With v3.7.3.1, going to page "A" now redirects correctly to page "B".
- (PC) Fix minor Table of Contents issues for Wikitext / HTML databases
+ (PC) Fix minor Table of Contents issues for Wikitext / HTML databases[edit]
There were a number of minor Table of Contents (TOC) issues where clicking on the TOC would not scroll down to the correct header section.
@@ -317,7 +317,7 @@
Note that aside from the Wikivoyage item, the other TOC items probably affect < .1% of all pages.
- Next release: v3.7.4
+ Next release: v3.7.4[edit]
The PC version is a major release. It fixes a breaking change for importing 2016-07 wikis. It also adds Table of Contents for HTML databases, fixes an HTTP server bug, and includes mwad -- a new utility for creating XML dumps
@@ -346,7 +346,7 @@
The Android version is a minor release. It handles the new 2016-07 wikis and the Table of Contents support.
I fell behind on French wikis this week while waiting for the new month's dumps. French Wikipedia is uploading now, and the rest will be generated and uploaded during the week.
@@ -355,7 +355,7 @@
In the meantime, I added Haitian Wikipedia as per the request at https://github.com/gnosygnu/xowa/issues/67
- (PC) Fix 2016-07 English Wikipedia import failure
+ (PC) Fix 2016-07 English Wikipedia import failure[edit]
2016-07 English Wikipedia failed to import. This was due to the categorylinks.sql file and some specific SQL parsing in XOWA.
@@ -364,7 +364,7 @@
v3.7.2.1 resolves this issue, and English Wikipedia now imports correctly
- (Server) Fix images not showing for Wikitext databases
+ (Server) Fix images not showing for Wikitext databases[edit]
This was kindly reported by ve3lst in https://github.com/gnosygnu/xowa/issues/68 I broke images for Wikitext databases back in v3.6.4.3. Note that images do show for HTML databases (databases from Download Central).
@@ -373,13 +373,13 @@
v3.7.2.1 resolves this issue. Viewing a page on the HTTP Server will now shows images.
- (PC) Add Table of Contents support for HTML databases on the PC
+ (PC) Add Table of Contents support for HTML databases on the PC[edit]
v3.7.2.1 now generates Table of Contents for HTML databases on the PC. Note that this only affects new wikis such as Haitian and French. The 2016-07 version of English Wikipedia will have them when I release it next week. I'll redo German Wikipedia later to include this as well.
- (PC) Include mwad (MediaWiki API dump) for creating XML dumps for Wikia and other wikis {contributed by Mattze96}
+ (PC) Include mwad (MediaWiki API dump) for creating XML dumps for Wikia and other wikis {contributed by Mattze96}[edit]
For those who are unaware, Mattze96 was the amazing developer who contributed the original HTTP Server code. This time, Mattze96 contributed mwad: the MediaWiki API dump tool. This tool allows creating XML dumps for Wikia and other wikis (https://wiki.archlinux.org/).
@@ -388,7 +388,7 @@
If you use XOWA for Wikia wikis, or other non-Wikimedia wikis, you definitely want to try it out. For more info, see App/Import/mwad as well as https://github.com/Mattze96/mwad and https://github.com/gnosygnu/xowa/issues/66
- (PC) Fix minor Wikibase issues, including wikibase-item
+ (PC) Fix minor Wikibase issues, including wikibase-item[edit]
There are two issues here:
@@ -402,13 +402,13 @@
- (PC) Target Java 1.7, not Java 1.8
+ (PC) Target Java 1.7, not Java 1.8[edit]
I noticed that I accidentally bumped the Java version requirement from 1.7 to 1.8 back in 2016-03. v3.7.2.1 now requires Java 1.7 only
- Next release: v3.7.3
+ Next release: v3.7.3[edit]
- (PC & Android) Fix broken search for multiple words in 2016-05 wikis and earlier
+ (PC & Android) Fix broken search for multiple words in 2016-05 wikis and earlier[edit]
The PC version is a minor release. It adds Gallery support for HTML dtabases.
@@ -452,13 +452,13 @@
The Android version is a minor release. It fixes a number of severe crashes for outlier situations.
- (Wiki) 2016-06 German Wiktionary, Wikisource, Wikivoyage, Wikiquote, Wikibooks, Wikiversity, and Wikinews
+ (Wiki) 2016-06 German Wiktionary, Wikisource, Wikivoyage, Wikiquote, Wikibooks, Wikiversity, and Wikinews[edit]
- (PC) Support Gallery
+ (PC) Support Gallery[edit]
On the PC, the HTML databaes showed Galleries vertically and with incorrect styles (no gray border box).
@@ -467,7 +467,7 @@
This build fixes some galleries for the existing 2016-06 wikis. Unfortunately, the other galleries can only be fixed in the next HTML dump: 2016-07 and beyond.
- (PC & Android) More minor fixes for Download Central including connection disruption and WAKE_LOCK fixes
+ (PC & Android) More minor fixes for Download Central including connection disruption and WAKE_LOCK fixes[edit]
There are basically two types of fixes:
@@ -481,7 +481,7 @@
- (Android) Multiple fixes for severe crashes
+ (Android) Multiple fixes for severe crashes[edit]
There were a number of fixes for crashes in uncommon scenarios. Most of these involved switching SD cards, or deleting wikis outside XOWA. The crash was bad enough such that XOWA would not work unless the Storage files were cleared (or XOWA was reinstalled).
@@ -490,7 +490,7 @@
These are fixed in this version. For more info, see the Change log
- Next release: v3.7.2
+ Next release: v3.7.2[edit]
The PC version is a major release. It adds better html database support for certain images, handles the lsth parser function, and makes minor changes to the Download Central Info page
@@ -166,13 +166,13 @@
The Android version is a major release. It also includes the same better support for certain images.
- (Wiki) Publish 2016-08 English Wikipedia and German Wikipedia
+ (Wiki) Publish 2016-08 English Wikipedia and German Wikipedia[edit]
The 2016-08 versions of both wikis are finally up. You can get them through Download Central.
- (PC / Android) Better html database support for packed galleries, video thumbnails, and image maps
+ (PC / Android) Better html database support for packed galleries, video thumbnails, and image maps[edit]
There was a small percentage (< .1%) of images that didn't appear in the HTML databases. These include the following:
@@ -209,13 +209,13 @@
Finally, the 2016-08 English and German Wikipedia are the first wikis to use the multi-threaded builder. This allowed me to cut down the English Wikipedia generation time from 80 hours to 12 hours (with 2 high-grade 8-core machines). This was a significant under-the-cover change, but hopefully most of the kinks have been worked out.
- (PC) Support the lsth parser function
+ (PC) Support the lsth parser function[edit]
I discovered that a number of English Wikipedia pages used the {{#lsth}} function. In brief, this function includes a section from another page on the current page. For example: https://en.wikipedia.org/wiki/10s_BC . I ended up rewriting the lst functions to support this behavior.
- (PC) Add torrent link / MD5 info to the Download Central Info page
+ (PC) Add torrent link / MD5 info to the Download Central Info page[edit]
Based on some welcome feedback from malakov1, I added a torrent link to the Download Central Info page. For example, Special:XowaDownloadCentralInfo?task id=96. Note that these torrent links are to the full archive.org folder, not the task. In particular, the following two types will be included:
@@ -249,7 +249,7 @@
In addition, the Download Central Info page now includes MD5 and file size info.
- Next release: v3.9.1
+ Next release: v3.9.1[edit]
I'm postponing the release till tomorrow night. I uploaded 2016-08 English and German Wikipedia, but there are a few minor tweaks I want to make before release.
@@ -269,13 +269,13 @@
Thanks.
I'm skipping the release this week. I'm still working on the 2016-08 English Wikipedia. I am close, but I still don't have a clean HTML dump yet. Please check again next week.
The PC version has no release.
@@ -284,7 +284,7 @@
The Android version has a trivial release to fix an uncommon crash when starting XOWA.
- (Android) Fix app crash when starting XOWA: Unable to start activity ComponentInfo{org.xowa/org.wikipedia.page.PageActivity}
+ (Android) Fix app crash when starting XOWA: Unable to start activity ComponentInfo{org.xowa/org.wikipedia.page.PageActivity}[edit]
Some quick details:
@@ -304,7 +304,7 @@
For this version, I added better guards against null references around the cited code. Thanks to the anonymous users who sent me the crash reports
- Next release: v3.8.4
+ Next release: v3.8.4[edit]
The PC version is a major release. It fixes random "SSL peer shut down incorrectly" when downloading, "Script Error:Module Protection expiry" on many en.w pages, and some parser issues on pl.w.
@@ -326,13 +326,13 @@
The Android version has no release.
The 2016-07 versions of the Polish wikis are up. You can get them through Download Central.
- (PC) Fix random "SSL peer shut down incorrectly" when downloading database dumps
+ (PC) Fix random "SSL peer shut down incorrectly" when downloading database dumps[edit]
In the past week, XOWA would fail while downloading database dumps from the Wikimedia servers at https://dumps.wikimedia.org/backup-index.html . After some investigation, it looks like Wikimedia is currently resetting all connections at the 17 and 47 minute mark of every hour (EX: 1:17, 1:47, 2:17, 2:47, etc.) . For more info, see https://lists.wikimedia.org/pipermail/xmldatadumps-l/2016-August/001325.html
@@ -366,7 +366,7 @@ http://ftp.fi.muni.cz/pub/wikimedia/
Many thanks to Kevin Day and your.org for their assistance and support with this issue.
- (PC) Fix "Script error:Module:Effective protection expiry" for many English Wikipedia pages
+ (PC) Fix "Script error:Module:Effective protection expiry" for many English Wikipedia pages[edit]
The 2016-07-20 version of English Wikipedia would show "Script error" on many pages. This was due to a minor typo on my side for "infinite" vs "infinity". It is fixed with of this release.
@@ -375,7 +375,7 @@ http://ftp.fi.muni.cz/pub/wikimedia/
Thanks to William to reporting this issue.
- (PC) Fix parser issues for Polish Wikipedia pages, including location maps and broken infoboxes
+ (PC) Fix parser issues for Polish Wikipedia pages, including location maps and broken infoboxes[edit]
Polish Wikipedia required two major changes:
@@ -389,7 +389,7 @@ http://ftp.fi.muni.cz/pub/wikimedia/
- Next release: v3.8.3
+ Next release: v3.8.3[edit]
The PC version is a minor release. It fixes a bug with "invalid title" when clicking on the left-hand sidebar.
@@ -415,13 +415,13 @@ http://ftp.fi.muni.cz/pub/wikimedia/
The Android version is a minor release. It fixes a random crash when restarting the app while downloading wikis
The 2016-07 versions of the Arabic wikis are up. You can get them through Download Central.
- (PC) Fix "invalid title" when clicking on wikis in left-hand nav
+ (PC) Fix "invalid title" when clicking on wikis in left-hand nav[edit]
This was kindly reported by markusmaresch in https://github.com/gnosygnu/xowa/issues/73 . Basically, clicking on a wiki in the left-hand sidebar would fail with "invalid title". This was due to some changes I made with the UI in a recent release.
@@ -430,13 +430,13 @@ http://ftp.fi.muni.cz/pub/wikimedia/
v3.8.1 fixes the issue
- (PC) Minor wikibase update for "renderSnaks"
+ (PC) Minor wikibase update for "renderSnaks"[edit]
Wikidata (www.wikidata.org), or "Wikibase", is a continually evolving project. French Wikipedia started using two new methods recently: renderSnaks and renderSnak. I added support for these calls in this release. I also cleaned up some Wikibase code.
- (Android) Fix random failure when restarting XOWA while downloading wikis
+ (Android) Fix random failure when restarting XOWA while downloading wikis[edit]
A helpful anonymous user forwarded me a crash report for XOWA Android. Sometimes, XOWA Android would fail to restart when in the process of downloading wikis from Download Central. This was broken since the initial release of Download Central.
@@ -445,7 +445,7 @@ http://ftp.fi.muni.cz/pub/wikimedia/
This fix was pushed out by a separate Play Store release last week. It is included formally in the apk-build now.
- Next release: v3.8.2
+ Next release: v3.8.2[edit]
The PC version is a patch release. It fixes Categories not showing for pages with more than one word in the title.
- Show Catgories for pages with more than one word in the title
+ Show Catgories for pages with more than one word in the title[edit]
As per https://github.com/gnosygnu/xowa/issues/81#issuecomment-249666435 Categories would not show for certain pages. It turned out this was a careless bug which affected pages with more than one word in the title.
@@ -167,7 +167,7 @@
Thanks to Ope30 for catching this bug. There's also another one he caught regarding large categories. This will be fixed in a future release or by manually downloading patched databases. See https://github.com/gnosygnu/xowa/issues/81
The PC version is a major release. It has more Category fixes, more page sync changes, and a few other changes.
@@ -176,7 +176,7 @@
The Android version is a minor release. It has a fix for bad file downloads in Download Central.
- (Wiki) Release 2016-09 French, English and German Wikipedia
+ (Wiki) Release 2016-09 French, English and German Wikipedia[edit]
I published the French wikis last week, but I'm just listing them formally in this release.
@@ -199,7 +199,7 @@
Thanks to fake4d for pointing out the bad link before.
- (PC) More minor Category fixes including large categories, dynamic page list and wikidata.org
+ (PC) More minor Category fixes including large categories, dynamic page list and wikidata.org[edit]
v3.9.2.1 introduced a new Category system to support Categories in HTML dump mode. Unfortunately, a few items were left out.
@@ -222,25 +222,25 @@
Finally, these all work with both the Wikitext dumps and the HTML dumps. I still have to get them to work on Android.
- (PC) Page sync shows math and video images
+ (PC) Page sync shows math and video images[edit]
v3.9.2.1 added a page sync feature, but it didn't handle Math, video and pdf images. v3.9.4.1 now handles these. There are still a few other image types to handle (helper buttons / score), but sync should now work fine for 99% of pages.
- (PC / Android) Download Central does not loop endlessly if wrong file size downloaded
+ (PC / Android) Download Central does not loop endlessly if wrong file size downloaded[edit]
This is a bug that should hopefully not have affected anyone. While testing the downloads for English Wikipedia, I noticed that a "bad file size" error would basically cause Download Central to cycle endlessly. The only option would be to remove the entire task and resume.
- (PC) Show pages in MediaWiki namespace
+ (PC) Show pages in MediaWiki namespace[edit]
- (PC) Run GUI on Raspberry Pi
+ (PC) Run GUI on Raspberry Pi[edit]
As per https://github.com/gnosygnu/xowa/issues/85 the XOWA GUI was not able to run on the Raspberry Pi. I changed SWT to use WebKit in order to get this working. So far, I can only confirm that it works on my device, but hopefully it will work for others.
@@ -252,7 +252,7 @@
Many thanks to nstents for helping me test the builds.
- (PC) More parser fixes including Scribunto regex at end of string and gaps in argument keys
+ (PC) More parser fixes including Scribunto regex at end of string and gaps in argument keys[edit]
There were two significant fixes worth mentioning:
@@ -266,7 +266,7 @@
- Next release: v3.10.1
+ Next release: v3.10.1[edit]
I'm skipping the release this week. I'm working on a few changes to categories, and English Wikipedia is spilling over a little.
@@ -298,7 +298,7 @@
Thanks.
The PC version is a major release. It has a fix for broken Category pages, a new Category system, a new page sync feature, and other changes.
@@ -307,13 +307,13 @@
The Android version is a minor release. It has a fix for dropped connections in Download Central.
- (PC) Fix for Category pages not working
+ (PC) Fix for Category pages not working[edit]
- (PC) New Category system to handle HTML dumps
+ (PC) New Category system to handle HTML dumps[edit]
As per https://github.com/gnosygnu/xowa/issues/81 Category pages were not showing for HTML dumps. I rewrote the Category system to handle this. Here are the high-level points:
@@ -339,19 +339,19 @@
There's a little more info at Category Overview for those interested.
- (PC) Basic page synchronization feature to get latest from online
+ (PC) Basic page synchronization feature to get latest from online[edit]
As per https://github.com/gnosygnu/xowa/issues/72 XOWA will now be able to sync pages directly from the online version. This feature is still a work-in-progress, and probably should only be done for selective pages. Certain pages won't sync correctly for a few more releases -- namely, pages with Math. See App/Xtn/Page_sync for more info.
- (PC / Android) Download Central changes for dropped connections / Mac OS X
+ (PC / Android) Download Central changes for dropped connections / Mac OS X[edit]
As per https://github.com/gnosygnu/xowa/issues/80 dropped connections in Download Central would appear to hang on Mac OS X. This release should now force Mac OS X to report dropped connections. In addition, it also will try to reconnect for a minute once a connection is dropped, before giving up.
- (PC) Various parser changes including Protectiong Banner, stack overflow, and invalid UTF-8
+ (PC) Various parser changes including Protectiong Banner, stack overflow, and invalid UTF-8[edit]
This release has a bunch of parser changes. The Change log has a complete list. The most relevant items are the following:
@@ -368,7 +368,7 @@
- (PC) Other minor changes including read-only support, torrent-file links and docs for HTML dump
+ (PC) Other minor changes including read-only support, torrent-file links and docs for HTML dump[edit]
Thanks to multiple users, this build also resolves some minor issues:
@@ -388,7 +388,7 @@
Also, at risk of omission, additional thanks to markusmaresch for reporting the Mac OS X issue, and MDE186 for testing the page sync feature.
- Next release: v3.9.3
+ Next release: v3.9.3[edit]
This week has no release. I'm working on a variety of items based on issues at https://github.com/gnosygnu/xowa/issues Thanks to Ope30, markusmarech, and some anonymous others for all their input!
diff --git a/home/wiki/Blog/2016-10.html b/home/wiki/Blog/2016-10.html
index e31a91c46..706d42b1d 100644
--- a/home/wiki/Blog/2016-10.html
+++ b/home/wiki/Blog/2016-10.html
@@ -25,13 +25,13 @@
I'm skipping the release this week. I have a few minor fixes, but it doesn't warrant a new release.
@@ -141,7 +141,7 @@
Otherwise, I uploaded Polish this past week and am working on Swedish now.
The PC version is a minor release. It adds filtering to Download Central, better support for English Wikivoyage, and fixes errors in the Import Offline page
@@ -150,27 +150,27 @@
The Android version is a minor release. It also adds filtering to Download Central.
- (Wiki) Release 2016-10 English and German wikis (Wiktionary, Wikisource, Wikivoyage, Wikiquote, Wikibooks, Wikiversity, Wikinews)
+ (Wiki) Release 2016-10 English and German wikis (Wiktionary, Wikisource, Wikivoyage, Wikiquote, Wikibooks, Wikiversity, Wikinews)[edit]
The 2016-10 versions of the English and German wikis are up. You can get them at Download Central, or through these pages:
- (PC / Android) Allow filtering wikis by language / type in Download Central
+ (PC / Android) Allow filtering wikis by language / type in Download Central[edit]
Download Central now has a lot of wikis. I added some basic filtering to allow selection by language or wiki type. I'll be adding more customization to Download Central as time goes on, but hopefully this should make the list more manageable.
- (PC) Add better support for English Wikivoyage
+ (PC) Add better support for English Wikivoyage[edit]
I discovered a number of issues with 2016-10 English Wikivoyage:
@@ -190,13 +190,13 @@
In addition, there were issues with Chinese pages on English Wiktionary due to an obscure LuaJ error. This too was resolved in this release.
- (PC) Fix import errors in Import/Offline
+ (PC) Fix import errors in Import/Offline[edit]
Dashboard/Import/Offline was broken due to the recent changes in the Category system. In addition, there were a few other minor fixes.
- Next release: v3.11.2
+ Next release: v3.11.2[edit]
The PC version is a minor release. It now shows the 2016-10 entries for English and German Wikipedia in Download Central.
@@ -222,7 +222,7 @@
Thanks to Ope30 for reporting the bug (https://github.com/gnosygnu/xowa/issues/90).
The PC version is a major release. It adds better category support, fixes a Scribunto "Script error out of bounds", and a new custom scripting system.
@@ -231,21 +231,21 @@
The Android version is a minor release. It has a possible fix for some devices failing to load XOWA when permissions are revoked and then regranted.
- (Wiki) Release 2016-10 English and German Wikipedia
+ (Wiki) Release 2016-10 English and German Wikipedia[edit]
The 2016-10 versions of both wikis are up. You can get them through:
- (PC) Multiple category changes, including performance, international sorting, numeric sorting, and HTML database loading
+ (PC) Multiple category changes, including performance, international sorting, numeric sorting, and HTML database loading[edit]
- (PC) Fix for "Script error: index out of bounds" on 2016-10 enwiki pages
+ (PC) Fix for "Script error: index out of bounds" on 2016-10 enwiki pages[edit]
A number of pages in 2016-10 English Wikipedia would should "Script error: index out of bounds" in the Infobox area near the Coordinates. For example, https://en.wikipedia.org/wiki/Paris This was fixed in this release
- (PC) Add custom scripting support through standalone javascript / lua files
+ (PC) Add custom scripting support through standalone javascript / lua files[edit]
There's no release this week. I'm working on a category performance enhancement before starting on 2016-10 wikis.
diff --git a/home/wiki/Blog/2016-11.html b/home/wiki/Blog/2016-11.html
index f71b34336..bd9347916 100644
--- a/home/wiki/Blog/2016-11.html
+++ b/home/wiki/Blog/2016-11.html
@@ -25,13 +25,13 @@
This week is also a push. There were more changes, especially with Russian Wikipedia, but I can't give a release my full attention until next week.
@@ -121,7 +121,7 @@
The 2016-11 Russian Wikis are up. I'll try to work on the 2016 Italian wikis next.
There is no release this week. I've worked on a few Page sync issues found by khanhhung2512 as well as a new application auto-updater. I may skip next week also due to the holiday season as well as some personal commitments.
@@ -130,7 +130,7 @@
In the meantime, I uploaded 2016-11 German Wikipedia as well as the Dutch and Afrikaans Wikis. I'll be working on the Russian wikis and French Wikipedia.
The PC version is a minor release. It fixes some Wikibase parsing issues and handles some regression issues, notably bookmarks and variants.
@@ -139,7 +139,7 @@
The Android version is a minor release. It also adds filtering to Download Central.
- (Wiki) Publish 2016-10 French, Polish, Swedish, Spanish wikis. Also, 2016-11 English Wikipedia
+ (Wiki) Publish 2016-10 French, Polish, Swedish, Spanish wikis. Also, 2016-11 English Wikipedia[edit]
As it's been a few weeks since the last release, there have been several wiki releases since then.
@@ -151,7 +151,7 @@
A special thanks to Ope30 for downloading and testing all these wikis.
- (PC) Fix regression errors, including bookmarks, variants, clicking on images, and wrong number of reported pages
+ (PC) Fix regression errors, including bookmarks, variants, clicking on images, and wrong number of reported pages[edit]
There were a number of regression errors that have crept in over the last few releases. Namely, these are:
@@ -174,7 +174,7 @@
These have been fixed in this release. Thanks to khanhhung2512 and another anonymous user for reporting these issues.
- (PC) Fix various minor Wikibase errors with geocoordinate, time, and quantity
+ (PC) Fix various minor Wikibase errors with geocoordinate, time, and quantity[edit]
There were some minor Wikibase issues. The most notable of these involved time data which caused script errors on all Polish Wikipedia Software pages. The rest involved many fewer pages (< 100).
@@ -183,7 +183,7 @@
To get more info on these, see Change log/v3.11.2.1 and the Wikibase entries
- (PC) Make minor changes to Import/Offline page
+ (PC) Make minor changes to Import/Offline page[edit]
There were a number of minor issues with the Import/Offline page, primarily due to the Category changes in 2016-09. I made a few changes to eliminate redundant downloads as well as to intelligently detect dump files. However, I'll probably make more in the coming months when time permits.
@@ -192,7 +192,7 @@
Again, thanks go to khanhhung2512 and another anonymous user for reporting these issues.
- (Dev) Simplify usage of XOWA as an embeddable parser
+ (Dev) Simplify usage of XOWA as an embeddable parser[edit]
XOWA now supports usage as an embeddable parser in other apps. More information is at Dev/Parser/Embeddable
@@ -201,7 +201,7 @@
Thanks here are due to Rüdiger Gleim for suggesting the interface as well as providing valuable feedback
- Next release: v3.11.3
+ Next release: v3.11.3[edit]
I'm postponing the official release to next week. There are still only a handful of issues, and unfortunately, I don't have the time this week to do a full release.
diff --git a/home/wiki/Blog/2016-12.html b/home/wiki/Blog/2016-12.html
index d9ca9b229..efc8d6666 100644
--- a/home/wiki/Blog/2016-12.html
+++ b/home/wiki/Blog/2016-12.html
@@ -25,49 +25,49 @@
Just a quick note. Due to the holiday season and personal obligations, there is no release this week. There will be a release next week with a new configuration system.
There is no PC release this week. I've been working on the new Configuration system as well as Section editing.
@@ -129,7 +129,7 @@
The Android version has a minor release.
- (Android) Remove horizontal scrollbars by hiding Navigation boxes by default
+ (Android) Remove horizontal scrollbars by hiding Navigation boxes by default[edit]
This was a change due to the feedback from a Google Play review (which has since been deleted). There's a little more documentation at https://github.com/gnosygnu/xowa/issues/112
@@ -158,7 +158,7 @@
- Next release: v3.12.4
+ Next release: v3.12.4[edit]
I'm skipping next week due to personal reasons. This means that the next possible release would be Christmas weekend. I'll try to push something out then, but since may rely on a quick "beta" release.
@@ -172,7 +172,7 @@
The PC version is a minor release. It fixes an import issue with English Wikipedia on older machines, has several Scribunto and Wikibase fixes for Russian wikis, and has some page sync issues
@@ -181,7 +181,7 @@
The Android version has no release.
- (Wiki) Publish 2016-11 Dutch and Russian wikis. Also, 2016-11 German Wikipedia
+ (Wiki) Publish 2016-11 Dutch and Russian wikis. Also, 2016-11 German Wikipedia[edit]
As per the section title, 2016-11 Dutch and Russian wikis are up at archive.org. You can check Wiki_setup/Listing or Special:XowaDownloadCentral
@@ -190,7 +190,7 @@
Again, thanks to Ope30 for testing these wikis.
- (PC) Fix "stalled" English Wikipedia import on older machines
+ (PC) Fix "stalled" English Wikipedia import on older machines[edit]
This issue was reported in issue 98 and and issue 108.
@@ -202,7 +202,7 @@
This issue was resolved by adding a new SQL index during the category import. The total time will still be noticeably longer (from 2 hours to 5 hours), but it should complete in the end.
- (PC) Fix various minor Scribunto and Wikibase errors with Russian Wikipedia including inferred datatype
+ (PC) Fix various minor Scribunto and Wikibase errors with Russian Wikipedia including inferred datatype[edit]
There were a number of minor fixes around the 2016-11 Russian wikis.
@@ -214,7 +214,7 @@
For the other changes, you can take a look at the Scribunto and Wikibase items at Change log/v3.12.1.1
- (PC) Fix page sync issues when syncing File or Chinese pages with math
+ (PC) Fix page sync issues when syncing File or Chinese pages with math[edit]
First, thanks to khanhhung2512 for reporting these issues.
@@ -237,7 +237,7 @@
These fixes are included in this release.
- Next release: v3.12.2
+ Next release: v3.12.2[edit]
- Personal: Vacation and limited reachability (2017-01-13 17:00 Fri)
+ Personal: Vacation and limited reachability (2017-01-13 17:00 Fri)[edit]
I'm going to be out on vacation for about a week and a half. I'll only have limited access to the internet, and won't be able to make any releases.
@@ -124,7 +124,7 @@
Thanks!
I'm skipping the release for tonight. There was one regression issue introduced last week: Random not working in HTML databases. However, that can be fixed with an options change: https://github.com/gnosygnu/xowa/issues/121#issuecomment-270473393
@@ -136,7 +136,7 @@
Also, I ran into an issue with 2017-01 English Wikipedia. Unfortunately that will also be postponed till near end of month as well.
The PC version is a major release. It adds a new Option system and includes a lot of related changes.
@@ -145,7 +145,7 @@
The Android version has no release.
- (Wiki) Publish 2016-12 Italian and Swahili wikis. Also, 2016-12 English Wikipedia
+ (Wiki) Publish 2016-12 Italian and Swahili wikis. Also, 2016-12 English Wikipedia[edit]
2016-12 Italian and Swahili wikis are up at archive.org. 2016-12 English Wikipedia was also pushed out earlier this month.
@@ -154,7 +154,7 @@
To download these wikis, please check Wiki_setup/Listing or Special:XowaDownloadCentral
The major change for this release was the Options system. It was a multi-week effort that overhauled various parts of the system. You can try the new Options systems at the Options page
@@ -191,7 +191,7 @@
Of course, if you run into issues, please let me know at https://github.com/gnosygnu/xowa/issues I'm hoping though that this will be a pleasant, uneventful change.
- (PC) Change versioning scheme to semantic versioning
+ (PC) Change versioning scheme to semantic versioning[edit]
Since the start, XOWA used a date-of-release versioning scheme. For example, version 3.12.2.1 meant the version released in the 3rd year after XOWA's release, in the 12th month and the 2nd week.
@@ -242,7 +242,7 @@
Finally, all releases are considered stable. So, whenever a patch release comes out, it will be promoted to the official download for all new users. If it's safe enough for new users to try, it's definitely safe enough for existing users as well.
- (PC) Fix mass parse performance issues when generating English Wikipedia
+ (PC) Fix mass parse performance issues when generating English Wikipedia[edit]
This was an issue I discovered when generating the 2016-12 English Wikipedia. It takes about 25 hours to dump English Wikipedia on an 8 core machine. Due to recent changes with Embeddable (using XOWA as a MediaWiki parser), this number grew to about 36 hours. In some cases, it even failed with OutOfMemory exceptions.
@@ -251,7 +251,7 @@
This build brings the build time back to 25 hours.
- Next week: v4.0.1.1701
+ Next week: v4.0.1.1701[edit]
I was planning to do a release tonight, but ran into last-minute issues. I'm going to push for a release tomorrow or possibly next Sunday.
diff --git a/home/wiki/Blog/2017-02.html b/home/wiki/Blog/2017-02.html
index a17b56ec4..2d5d7a06a 100644
--- a/home/wiki/Blog/2017-02.html
+++ b/home/wiki/Blog/2017-02.html
@@ -25,49 +25,49 @@
The PC version is a major release. It adds page deletion, category updates, wiki import, and a high-DPI machine support.
@@ -152,10 +152,10 @@
The Android version has no release.
- (Wiki) Publish 2017-02 English Wikipedia and 2017-02 Gujarati wikis
+ (Wiki) Publish 2017-02 English Wikipedia and 2017-02 Gujarati wikis[edit]
In addition, I reuploaded the entire English Wikipedia file database set. This is a periodic task which is necessary to keep the image databases small for new users.
@@ -199,7 +199,7 @@
Also, per request, I generated 2017-02 Gujarati wikis. See Wiki_setup/Gujarati_wikis
This build adds a Delete page button. To use it, do the following:
@@ -230,7 +230,7 @@
- (PC) Support editable Categories
+ (PC) Support editable Categories[edit]
This build also adds editable Categories. To try it, do the following:
@@ -253,7 +253,7 @@
This feature is also mainly for personal wikis. However, it will also work with Wikimedia wikis (like en.wikipedia.org)
- (PC) Add Import option for Personal wikis
+ (PC) Add Import option for Personal wikis[edit]
The previous build didn't have an easy way to move a personal wiki from one machine to another. This build now has an import button. To use it, do the following:
@@ -273,7 +273,7 @@
- (PC) Fix extremely short url bar on some machines
+ (PC) Fix extremely short url bar on some machines[edit]
XOWA had issues with machines with different DPI settings. This resulted in one of the following:
@@ -290,7 +290,7 @@
Both of these are resolved with this build.
- (PC) Other changes including curid, Special:XowaSql, and keyboard shortcuts
+ (PC) Other changes including curid, Special:XowaSql, and keyboard shortcuts[edit]
This build also has a few other notable changes:
@@ -321,7 +321,7 @@
- (Dev) Change license to GPLv3 / Apache2
+ (Dev) Change license to GPLv3 / Apache2[edit]
A user was kind enough to suggest supporting personal wikis. These are standalone wikis that are entirely created and edited by a user. A reddit thread was created and there looks like there's some interest in the worldbuilding community:
@@ -398,7 +398,7 @@
I've used the XOWA home wiki as a personal wiki for over three years, and find it useful. Hopefully others will as well.
- (PC) Add minor changes to Download Central
+ (PC) Add minor changes to Download Central[edit]
There were basically two minor changes:
@@ -412,7 +412,7 @@
The PC version is a major release. It adds a new in-app updater and better support for images in custom wikis
@@ -435,7 +435,7 @@
The Android version has no release.
- (PC) Add new in-app updater
+ (PC) Add new in-app updater[edit]
v4.1.0 has a new in-app updater. It has two main features:
@@ -452,7 +452,7 @@
More info is available at App/Setup/Update/In-app
- (PC) Add better support for images in Wikia and other custom wikis
+ (PC) Add better support for images in Wikia and other custom wikis[edit]
XOWA had only minimal support for images in Wikia wikis. However, as a result of tickets #124 and #125, the following changes were made:
@@ -481,7 +481,7 @@
- (PC) Fix Random not working for HTML databases
+ (PC) Fix Random not working for HTML databases[edit]
- (PC) Add Creative Commons footer to bottom of page
+ (PC) Add Creative Commons footer to bottom of page[edit]
This was a minor request made by Ope30 also. Pages will now show the Creative Commons footer at the bottom of the page. I also redesigned the footer as well.
The PC version is a major release. It adds full-text search for the Wikipedias, redesigns Special:XowaSearch, and fixes parsing errors in 2017-03 Russian Wikipedia.
@@ -155,27 +155,27 @@
The Android version is a major release. It also adds full-text search for the Wikipedias.
- (Wiki) Publish 2017-03 English Wikipedia, 2017-03 Russian, 2017-03 Hindi, and 2017-03 Tibetan wikis
+ (Wiki) Publish 2017-03 English Wikipedia, 2017-03 Russian, 2017-03 Hindi, and 2017-03 Tibetan wikis[edit]
These wikis were uploaded over the course of the month. You can get them from Download Central or see the following links:
XOWA finally supports full-text search. This was a complicated change involving a new Special page (Special:XowaSearch) and a new Java library (Lucene). There will be more changes in future releases, but the current version should work well enough for PCs as well as Android devices.
@@ -190,13 +190,13 @@
For more details see App/Full-text_search
A basic version of Special:XowaSearch was released to allow full-text search for personal wikis. The current version cleans up the UI and adds features like paging and highlighted snips.
- (PC) Add search and allpages button
+ (PC) Add search and allpages button[edit]
In tandem with the above, XOWA now has two separate buttons:
@@ -213,13 +213,13 @@
For those who find the two buttons cluttering, they can be selectively shown / hidden at Special:XowaCfg?grp=xowa.gui.general
- (PC) Fix wikibase "attempt to call nil" errors for 2017-03 Russian wikis
+ (PC) Fix wikibase "attempt to call nil" errors for 2017-03 Russian wikis[edit]
The 2017-03 Russian Wikipedia had a bunch of Script errors with "attempt to call nil". Most of these involved many Wikibase changes introduced over the past year, but finally used in a Module within Russian Wikipedia. These errors have been fixed with the current version
- (PC) Fix minor issues including page_sync requiring double refresh, long directory names for images, and rare import errors
+ (PC) Fix minor issues including page_sync requiring double refresh, long directory names for images, and rare import errors[edit]
There are basically three issues worth highlighting:
@@ -236,7 +236,7 @@
- (PC) Add minor GUI changes including custom url formats, direct HTML from SWT browser, and options link
+ (PC) Add minor GUI changes including custom url formats, direct HTML from SWT browser, and options link[edit]
These are a few minor changes worth detailing:
@@ -253,7 +253,7 @@
The PC version is a major release. It adds night mode, automatic page backup, performance improvements, an early-version of full-text search, and better support for French Wikipedia.
@@ -276,7 +276,7 @@
Note that there are no upgrade versions for v4.4. This is due to XULRunner changes which would make the upgrade almost as large as the entire app.
- (Wiki) Publish 2017-02 German Wikipedia and 2017-02 French Wikipedia
+ (Wiki) Publish 2017-02 German Wikipedia and 2017-02 French Wikipedia[edit]
Both wikis were updated during the week. You can get them from Download Central or see the following links:
@@ -290,7 +290,7 @@
XOWA now has night mode. To enable it, do Menu -> View -> Toggle Night mode. More info is at App/UI/Night_mode
@@ -299,7 +299,7 @@
I implemented this feature over the past few days, so there may be some spots I missed. Also, if you have any suggestions about colors, CSS, or icons, please do contact me at Help/Feedback.
XOWA now does a simple backups whenever pages are edited. This feature is intended primarily for personal wikis.
@@ -322,7 +322,7 @@
- (PC) Improve performance for starting app as well as creating / loading personal wikis
+ (PC) Improve performance for starting app as well as creating / loading personal wikis[edit]
This version has a number of performance improvements:
@@ -339,7 +339,7 @@
- (PC) Update XULRunner to v31 for Windows machines
+ (PC) Update XULRunner to v31 for Windows machines[edit]
The Main Page for 2017-02 French Wikipedia now uses the CSS flex directive. Unfortunately, this is not supported in XULRunner v24 but it is in XULRunner v31.
@@ -359,7 +359,7 @@
- (PC) Add preiminary full-text search for personal-wikis
+ (PC) Add preiminary full-text search for personal-wikis[edit]
XOWA now has a basic full-text search feature. It should only be used for small wikis (like a personal wiki). It works by opening up every single page and searching for the text phrase. Although this sounds slow, it performs relatively quickly on modern generation machines (especially if you have a SSD). It also has the advantage of not taking up any space for search-indexing.
@@ -368,13 +368,13 @@
This feature will be expanded in the coming months, but any feedback is welcome. To try to it, go to Special:XowaSearch
- (PC) Other minor fixes, including ?curid for command-line and no more current directory for logs
+ (PC) Other minor fixes, including ?curid for command-line and no more current directory for logs[edit]
There are a bunch of other minor fixes, but I'll highlight two which were reported by users:
- ?curid did not work on the command-line
+ ?curid did not work on the command-line[edit]
XOWA added a ?curid feature to look up a page by page-id. Unfortunately, this wasn't working for command-line calls.
@@ -383,7 +383,7 @@
This build fixes this bug.
- No more current directory for logs
+ No more current directory for logs[edit]
XOWA stores its logs at C:\xowa\user\anonymous\app\tmp\log. XOWA used to store the current directory in a folder called current. Unfortunately, this caused problems on Linux systems when two or more different-permissioned users were running XOWA.
@@ -392,7 +392,7 @@
This version replaces the current directory with a timestamp directory which should now reduce the likelihood of errors.
+ Personal: A new job and other changes (2017-04-02 12:00 Sun)[edit]
+
+
+ XOWA development will be undergoing some changes in the coming months. As of tomorrow, I'll be starting a new job, and consequently, I won't be able to give as much time to XOWA as before. In fact, few people know this, but I spent the past year working full-time on XOWA. So, strictly by numbers, XOWA is going to go from a 60-80 hour per week schedule to something much less.
+
+
+ With that said, XOWA development will not halt. As demonstrated by the full-year work effort, I care deeply about this project, and I do not plan to stop developing XOWA any time in the future. However, it does mean that there will be a few changes.
+
+
+ First, the pace of development will slow down. The past year has seen a lot of development: from XOWA Android to Download Central to personal wikis to full-text search[1] Given the new schedule, it won't be at all possible to match that output. I still have a bunch of major changes planned, but I expect that only two or three major changes will occur before the end of the year.
+
+
+ Second, I'll be producing Download Central wikis at a slower rate. I do want to do a full update of all wikis, especially with the recent addition of full-text search. However, if I run into issues, I may postpone a wiki for a few weeks to a month until I work them out. I'll try to provide some sort of schedule for changes, but things may be in flux for a while. As always, if you have any requests, please make them, and I'll definitely prioritize them.
+
+
+ Third, I'm going to turn my attention to making XOWA easier for other developers and power users. This means more documentation in building XOWA as well as the Download Central databases. I'd love to have some support from others, and really don't want to have XOWA development depend entirely on me.
+
+
+ I'm sure there will probably be other noticeable changes as well. Again, I want to assure you that XOWA is not going to go away anytime soon. If anything, it will continue to grow -- especially with more support from others.
+
+
+
+ ^There's also a lot more such as HTML databases, PageRank, Auto-complete URL bar, Page Sync, Options, ICU Categories, Page Banner, multi-threaded parsers, nightmode, hdpi support, and dozens of parser issues.
+
+
+
\ No newline at end of file
diff --git a/home/wiki/Blog/Archives.html b/home/wiki/Blog/Archives.html
index 0b4aa9f98..32c413072 100644
--- a/home/wiki/Blog/Archives.html
+++ b/home/wiki/Blog/Archives.html
@@ -22,13 +22,16 @@
Change log items are divided into the following high-level categories:
@@ -139,7 +139,7 @@
Note that PC changes will probably also affect Andriod and Server. All three apps share the same code-base.
For PC, Android, and Server, change log items are further divided into the following sub-categories:
@@ -159,10 +159,10 @@
The most important category to review is major. The other categories may be skipped due to lower importance (if they were more important, they would be bumped up to major).
- Windows / Linux / Mac OS X
+ Windows / Linux / Mac OS X[edit]
add
- Command-line: Expand instructions for generating HTML dumps. See: Dev/Command-line/Dumps
+ Command-line: Expand instructions for generating HTML dumps. See: Dev/Command-line/Dumps
major
diff --git a/home/wiki/Dashboard/Files/Deletion.html b/home/wiki/Dashboard/Files/Deletion.html
index b104e7e69..87c98ee56 100644
--- a/home/wiki/Dashboard/Files/Deletion.html
+++ b/home/wiki/Dashboard/Files/Deletion.html
@@ -45,7 +45,7 @@
This page allows you to delete unused images in your image databases.
(Press Expand to reveal more notes)
@@ -65,7 +65,7 @@
- Delete images using a database
+ Delete images using a database[edit]
This is a two-step process (Press Expand to reveal more notes):
diff --git a/home/wiki/Dashboard/Image_databases.html b/home/wiki/Dashboard/Image_databases.html
index d7a6de4f8..0be7e85a9 100644
--- a/home/wiki/Dashboard/Image_databases.html
+++ b/home/wiki/Dashboard/Image_databases.html
@@ -50,19 +50,19 @@
The following table lists image databases for old wikis. These databases are obsolete, and replaced by those in Download Central.
@@ -1836,10 +1836,10 @@
XOWA is an offline Wikipedia application. It can run an offline copy of Wikipedia on your computer by using any of the dumps at https://dumps.wikimedia.org It can run as a standalone GUI application, as a Firefox addon, or as a HTTP server.
XOWA runs on Linux, Windows, and Mac OS X. These instructions will assume the user is on a 64-bit Linux system. However, if you're on a different system, the same instructions still apply. Simply substitute "linux_64" with the appropriate XOWA operating system name from below:
@@ -119,7 +119,7 @@
XOWA is written in Java and requires 1.6 or above. It has seven dependencies:
@@ -151,10 +151,10 @@
Note that the last two libraries are not currently used in XOWA.
For many Java programmers my style will appear idiosyncratic if not downright strange.
diff --git a/home/wiki/Dev/Command-line.html b/home/wiki/Dev/Command-line.html
index 359532c24..9104a83c0 100644
--- a/home/wiki/Dev/Command-line.html
+++ b/home/wiki/Dev/Command-line.html
@@ -64,7 +64,7 @@
- Import simple.wikipedia.org through the command-line
+ Import simple.wikipedia.org through the command-line[edit]
@@ -81,7 +81,7 @@
- Import a different wiki by editing the build script
+ Import a different wiki by editing the build script[edit]
@@ -98,10 +98,10 @@
- Import a wiki with a manual download
+ Import a wiki with a manual download[edit]
- Download the wiki dump
+ Download the wiki dump[edit]
@@ -123,7 +123,7 @@
- Specify location of the wiki dump
+ Specify location of the wiki dump[edit]
// do not show a "Press enter to continue" at the end of the script
diff --git a/home/wiki/Dev/Command-line/Dumps.html b/home/wiki/Dev/Command-line/Dumps.html
index b4246eea5..6adabb8ec 100644
--- a/home/wiki/Dev/Command-line/Dumps.html
+++ b/home/wiki/Dev/Command-line/Dumps.html
@@ -116,7 +116,7 @@
The download-thumbs script downloads all thumbs for pages in a specific wiki. It works in the following way:
@@ -155,10 +155,10 @@
The script for simple wikipedia is listed below.
You will need the latest version of commons.wikimedia.org. Note that if you have an older version, you will have missing images or wrong size information.
@@ -167,13 +167,13 @@
For example, if you have a commons.wikimedia.org from 2015-04-22 and are trying to import a 2015-05-17 English Wikipedia, then any new images added after 2015-04-22 will not be picked up.
You also need to have the latest version of www.wikidata.org. Note that English Wikipedia and other wikis uses Wikidata through the {{#property}} call or Module code. If you have an earlier version, then data will be missing or out of date.
You should have a recent-generation machine with relatively high-performance hardware, especially if you're planning to generate images for English Wikipedia.
@@ -202,7 +202,7 @@
For English Wikipedia, it still takes about 50 hours for the entire process.
You should have a broadband connection to the internet. The script will need to download dump files from Wikimedia and some dump files (like English Wikipedia) will be in the 10s of GB.
@@ -211,7 +211,7 @@
You can opt to download these files separately and place them in the appropriate location beforehand. However, the script below assumes that the machine is always online. If you are offline, you will need to comment the "util.download" lines yourself.
- Pre-existing image databases for your wiki (optional)
+ Pre-existing image databases for your wiki (optional)[edit]
XOWA will automatically re-use the images from existing image databases so that you do not have to redownload them. This is particularly useful for large wikis where redownloading millions of images would be unwanted.
@@ -228,7 +228,7 @@
The script is written in the gfs format. This is a custom scripting format specific to XOWA. It is similar to JSON, but also supports commenting.
@@ -263,16 +263,16 @@
A lnki is short for "linkinternal". It refers to all wikitext with the double bracket syntax: [[A]]. A more elaborate example for files would be [[File:A.png|thumb|200x300px|upright=.80]]. Note that the abbreviation was chosen to differentiate it from lnke which is short for "linkenternal". For the purposes of the script, all lnki data comes from the current wiki's data dump
- Script: gnosygnu's actual English Wikipedia script (dirty; provided for reference only)
+ Script: gnosygnu's actual English Wikipedia script (dirty; provided for reference only)[edit]
diff --git a/home/wiki/Dev/Command-line/Site_meta.html b/home/wiki/Dev/Command-line/Site_meta.html
index cb54e06c3..068601331 100644
--- a/home/wiki/Dev/Command-line/Site_meta.html
+++ b/home/wiki/Dev/Command-line/Site_meta.html
@@ -50,7 +50,7 @@
XOWA can download the metadata for the Wikimedia wikis
Wikimedia exposes an API for accessing the meta-data for a given wiki. For example, for English Wikipedia, the following will return most of the meta-data around the wiki installation.
@@ -62,7 +62,7 @@ https://en.wikipedia.org/w/api.php?action=query&meta=siteinfo&siprop=gen
XOWA can call this API to download metadata for each wiki and save them in a database for data-processing. XOWA uses this info to resolve namespaces, but it will also incorporate other metadata from this API in future releases.
Assuming you are on a Windows system with XOWA installed at C:\xowa
diff --git a/home/wiki/Dev/Command-line/Thumbs.html b/home/wiki/Dev/Command-line/Thumbs.html
index c7cce4546..db3453557 100644
--- a/home/wiki/Dev/Command-line/Thumbs.html
+++ b/home/wiki/Dev/Command-line/Thumbs.html
@@ -116,7 +116,7 @@
The download-thumbs script downloads all thumbs for pages in a specific wiki. It works in the following way:
@@ -155,10 +155,10 @@
The script for simple wikipedia is listed below.
You will need the latest version of commons.wikimedia.org. Note that if you have an older version, you will have missing images or wrong size information.
@@ -167,13 +167,13 @@
For example, if you have a commons.wikimedia.org from 2015-04-22 and are trying to import a 2015-05-17 English Wikipedia, then any new images added after 2015-04-22 will not be picked up.
You also need to have the latest version of www.wikidata.org. Note that English Wikipedia and other wikis uses Wikidata through the {{#property}} call or Module code. If you have an earlier version, then data will be missing or out of date.
You should have a recent-generation machine with relatively high-performance hardware, especially if you're planning to generate images for English Wikipedia.
@@ -202,7 +202,7 @@
For English Wikipedia, it still takes about 50 hours for the entire process.
You should have a broadband connection to the internet. The script will need to download dump files from Wikimedia and some dump files (like English Wikipedia) will be in the 10s of GB.
@@ -211,7 +211,7 @@
You can opt to download these files separately and place them in the appropriate location beforehand. However, the script below assumes that the machine is always online. If you are offline, you will need to comment the "util.download" lines yourself.
- Pre-existing image databases for your wiki (optional)
+ Pre-existing image databases for your wiki (optional)[edit]
XOWA will automatically re-use the images from existing image databases so that you do not have to redownload them. This is particularly useful for large wikis where redownloading millions of images would be unwanted.
@@ -228,7 +228,7 @@
The script is written in the gfs format. This is a custom scripting format specific to XOWA. It is similar to JSON, but also supports commenting.
@@ -263,16 +263,16 @@
A lnki is short for "linkinternal". It refers to all wikitext with the double bracket syntax: [[A]]. A more elaborate example for files would be [[File:A.png|thumb|200x300px|upright=.80]]. Note that the abbreviation was chosen to differentiate it from lnke which is short for "linkenternal". For the purposes of the script, all lnki data comes from the current wiki's data dump
- Script: gnosygnu's actual English Wikipedia script (dirty; provided for reference only)
+ Script: gnosygnu's actual English Wikipedia script (dirty; provided for reference only)[edit]
diff --git a/home/wiki/Dev/Command-line/Wikidata.html b/home/wiki/Dev/Command-line/Wikidata.html
index 7c8112509..40cebf7a3 100644
--- a/home/wiki/Dev/Command-line/Wikidata.html
+++ b/home/wiki/Dev/Command-line/Wikidata.html
@@ -50,7 +50,7 @@
XOWA can import Wikidata through the command-line
- Import using the XML dump
+ Import using the XML dump[edit]
XOWA can build wikidata using the XML dump at www.mediwa/wikidatawiki/. This import is basically the same as an import of any other wiki.
@@ -75,7 +75,7 @@
add ('www.wikidata.org' , 'util.cleanup') {delete_tmp = 'y'; delete_by_match('*.xml|*.sql|*.bz2|*.gz');}
- Import using the JSON dump
+ Import using the JSON dump[edit]
As of v2.6.3, XOWA also provides basic support for building wikidata from the JSON dump. This support was added for the following reasons:
diff --git a/home/wiki/Dev/Config_files.html b/home/wiki/Dev/Config_files.html
index dc0dda19e..2c9b3cda6 100644
--- a/home/wiki/Dev/Config_files.html
+++ b/home/wiki/Dev/Config_files.html
@@ -18,7 +18,7 @@
XOWA uses a custom text format called gfs (an acronym for the gfs flexible script). It is a plain-text config file with a Java-like syntax.
@@ -47,7 +47,7 @@
- Recommended procedure for changes
+ Recommended procedure for changes[edit]
Please follow the steps below when changing config files. Windows instructions are provided in parentheses.
diff --git a/home/wiki/Dev/Config_files/Details.html b/home/wiki/Dev/Config_files/Details.html
index 4bcca8087..c57b1a365 100644
--- a/home/wiki/Dev/Config_files/Details.html
+++ b/home/wiki/Dev/Config_files/Details.html
@@ -45,7 +45,7 @@
- General characteristics
+ General characteristics[edit]
A gfs file has the following general characteristics:
@@ -69,13 +69,13 @@
Whitespace is not significant. There is no difference between the following commands.
@@ -111,7 +111,7 @@ app
Note that tabs (ASCII 9) and carriage returns (ASCII 13) are permitted but not recommended.
Booleans can be indicated in different forms as per the following table:
@@ -205,7 +205,7 @@ en.wikipedia.org
Note that for brevity's sake, 'y' and 'n' will be used.
Integers can be indicated with or without quotes. Note that without quotes is recommended.
diff --git a/home/wiki/Dev/Config_files/Examples.html b/home/wiki/Dev/Config_files/Examples.html
index 1eec64142..b55c309dc 100644
--- a/home/wiki/Dev/Config_files/Examples.html
+++ b/home/wiki/Dev/Config_files/Examples.html
@@ -18,7 +18,7 @@
- Changing a keyboard shortcut
+ Changing a keyboard shortcut[edit]
@@ -65,7 +65,7 @@
- Changing the HTML view
+ Changing the HTML view[edit]
XOWA stores the CSS for a wiki page in the following directory: C:\xowa\user\anonymous\wiki\ For example, for simple.wikipedia.org, the css is in C:\xowa\user\anonymous\wiki\simple.wikipedia.org
diff --git a/home/wiki/Dev/Design/Data_dump_format.html b/home/wiki/Dev/Design/Data_dump_format.html
index 5c196a308..585fa935b 100644
--- a/home/wiki/Dev/Design/Data_dump_format.html
+++ b/home/wiki/Dev/Design/Data_dump_format.html
@@ -45,7 +45,7 @@
- bzip2: disk space vs speed
+ bzip2: disk space vs speed[edit]
Currently, reading from a bzip2 file is much slower than unzipping and reading from the xml file.[1]
@@ -65,7 +65,7 @@
If you have the extra disk space, you will want to use the unzip route. If you are low on disk space, then you can use the bzip2 route instead
As of v2.4.1.1, XOWA has changed the database layout to be more simple and portable. Regular users should not notice any difference. Users who move XOWA wikis between computer systems will notice some benefits.
Large wikis will still generate multiple files. This includes English Wikipedia, German Wikipedia as well as about a dozen others. The primary reasons are as follows:
@@ -218,7 +218,7 @@
- Version compatibility
+ Version compatibility[edit]
The formats for wiks and files are interchangable between old and new formats. A user may keep their existing old file databases and still generate new wikis whenever they want to.
diff --git a/home/wiki/Dev/Design/Files/Wikia.html b/home/wiki/Dev/Design/Files/Wikia.html
index 10947b140..18e088412 100644
--- a/home/wiki/Dev/Design/Files/Wikia.html
+++ b/home/wiki/Dev/Design/Files/Wikia.html
@@ -51,7 +51,7 @@
diff --git a/home/wiki/Dev/Design/Offline_files.html b/home/wiki/Dev/Design/Offline_files.html
index 6ea2d7318..f0a1b6e0d 100644
--- a/home/wiki/Dev/Design/Offline_files.html
+++ b/home/wiki/Dev/Design/Offline_files.html
@@ -35,7 +35,7 @@
Note that Simple Wikipedia will take 24+ hours and 120 GB for the first run.
These steps must be run for the given wiki. Estimated size / times are provided for Simple Wikipedia.
diff --git a/home/wiki/Dev/Design/Site_config.html b/home/wiki/Dev/Design/Site_config.html
index ee1ee10ba..b6db12899 100644
--- a/home/wiki/Dev/Design/Site_config.html
+++ b/home/wiki/Dev/Design/Site_config.html
@@ -18,7 +18,7 @@
In /xowa/bin/any/xowa/cfg/wiki/api/, each folder has a sample file that can be used for a wiki. To use it do the following:
@@ -41,7 +41,7 @@
The remainder of this article documents the purpose of each file.
The "extensiontags" file lists active extensions. For example, to enable only <ref> and <references>, use the following two lines:
@@ -60,7 +60,7 @@ references
<code>if <complex test> then <do something> else <generate type error></code>
The "interwikimap" file lists active interwiki prefixes. For example, to enable only the interwiki prefix for commons, use the following:
diff --git a/home/wiki/Dev/Design/Sqlite/File-sizes.html b/home/wiki/Dev/Design/Sqlite/File-sizes.html
index 27879fc55..672127bf4 100644
--- a/home/wiki/Dev/Design/Sqlite/File-sizes.html
+++ b/home/wiki/Dev/Design/Sqlite/File-sizes.html
@@ -82,7 +82,7 @@
The ns_file_map argument is a new-line/semi-colon delimited string. The default value is the following:
@@ -97,7 +97,7 @@ Template;Module
Note that an empty string will default everything to be stored in the core database. If a single file database is desired, specify "".
This is a number that represents the maximum number of MB of text data that can be stored in the file. Note the following
@@ -131,7 +131,7 @@ Template;Module
- db_categorylink_max and db_wikidata_max value
+ db_categorylink_max and db_wikidata_max value[edit]
This is a number that represents the maximum number of MB of categorylink data that can be stored in the file. Note the following:
@@ -145,7 +145,7 @@ Template;Module
- db_wikidata_max value
+ db_wikidata_max value[edit]
This is a number that represents the maximum number of MB of wikidata label data that can be stored in the file. Note the following:
diff --git a/home/wiki/Dev/Environment/Viewer_apps.html b/home/wiki/Dev/Environment/Viewer_apps.html
index 118bea77b..94660767b 100644
--- a/home/wiki/Dev/Environment/Viewer_apps.html
+++ b/home/wiki/Dev/Environment/Viewer_apps.html
@@ -42,7 +42,7 @@
- Using viewer applications
+ Using viewer applications[edit]
Viewer applications are generally activated in one of the following two situations:
@@ -71,7 +71,7 @@
XOWA assigns a file-type to its default viewer-application.
@@ -83,7 +83,7 @@
If you wish to change the viewer application, you can do so in Options/Apps
Many articles will have external links. By default, clicking on these links will not result in any action. If you want the external links to open in a web browser, you will need to enable the web viewer application
@@ -92,7 +92,7 @@
If you wish to change the web browser, you can also do so in Options/Apps
This is a list of recommended open-source applications for each viewer type.
diff --git a/home/wiki/Dev/File/Setup/Linux.html b/home/wiki/Dev/File/Setup/Linux.html
index e41a94a7f..b8045e0da 100644
--- a/home/wiki/Dev/File/Setup/Linux.html
+++ b/home/wiki/Dev/File/Setup/Linux.html
@@ -62,7 +62,7 @@
If you need to compile ImageMagick from source, you can try the following:
diff --git a/home/wiki/Dev/File/Setup/Windows.html b/home/wiki/Dev/File/Setup/Windows.html
index dc7e4740a..81e2b1dbf 100644
--- a/home/wiki/Dev/File/Setup/Windows.html
+++ b/home/wiki/Dev/File/Setup/Windows.html
@@ -42,7 +42,7 @@
Inkscape is used for SVG rendering. Note that ImageMagick can be designated the SVG renderer, but it will fail to convert a small percentage of SVGs.[1]
@@ -85,7 +85,7 @@
The XOWA parser is constantly changing as it needs to accomodate live changes to MediaWiki parser. Moreover, the embeddable feature is a work in progress. The following is a list of known limitations:
@@ -188,7 +188,7 @@
The SWT library is an open-source GUI library, used by the open-source Java IDE Eclipse.
@@ -59,22 +59,22 @@
XOWA uses SWT in its GUI application across the 3 major operating systems: Windows, Linux, Mac OS X. This means that SWT handles everything visual: including buttons, text boxes, windows, and of course, the HTML browser.
- SWT is not used in HTTP Server or Android
+ SWT is not used in HTTP Server or Android[edit]
If you are running XOWA as an HTTP server or are using the Android version, then SWT is not used.
- Platform-specific jar
+ Platform-specific jar[edit]
SWT comes packaged in an operating system-specific jar called swt.jar. XOWA includes this at /xowa/operating_system_name/swt/swt.jar. For example, on Linux 64-bit, this file is at /xowa/linux_64/swt/swt.jar
SWT does a major update annually in coordination with the Eclipse release. Typically, this occurs in June. There are also development snapshots that are released during the course of the year.
@@ -83,7 +83,7 @@
XOWA will always update SWT shortly after the major version release. Depending on changes, it may also update after development snapshots.
XOWA v0.0.0 through v2.6.4 had been using SWT 4.2.
diff --git a/home/wiki/Dev/Sqlite/Tips.html b/home/wiki/Dev/Sqlite/Tips.html
index 4d0d50f97..853b828ba 100644
--- a/home/wiki/Dev/Sqlite/Tips.html
+++ b/home/wiki/Dev/Sqlite/Tips.html
@@ -62,7 +62,7 @@
@@ -94,7 +94,7 @@ WHERE name LIKE 'a%';
The clause name LIKE 'a%' does not use the index tbl1__name.
- = Alternative: Use comparison
+ = Alternative: Use comparison[edit]
If the like has a wildcard at the end, and the data is standardized to one case (all lowercase or all uppercase), use an equality instead:
@@ -108,7 +108,7 @@ WHERE name >= 'a' AND name < 'b';
This uses the index tbl1__name and returns the same data.
ORDER BY will do an expensive sort operation which may not use an index. This will come into play with multiple-table joins
@@ -124,13 +124,13 @@ ORDER BY t2.age
In most cases, SQLite will only apply one index. In this example, it will be the index for the JOIN. No index gets applied for the score column, even if one is available In some cases, SQLite will actually sort the result-set by the ORDER BY first, before it applies the WHERE.
- Alternative: denormalize the table
+ Alternative: denormalize the table[edit]
Putting all the columns in one table and building an index across them.
- Alternative: multiple where clauses
+ Alternative: multiple where clauses[edit]
SELECT t1.id
@@ -145,7 +145,7 @@ WHERE t2.age > 70 AND t2.age <= 100
;
- Beware bulk INSERTs into a table with a PRIMARY KEY
+ Beware bulk INSERTs into a table with a PRIMARY KEY[edit]
INSERT INTO
@@ -161,7 +161,7 @@ WHERE t2.age > 100 AND t2.age <= 130
Instead, insert into the table with an ORDER BY
This page lists various tests showing the effect of HTML Tidy. Each <h2> section header below corresponds to a separate test. Enable / Disable HTML Tidy at Options/HTML_Tidy to see the difference (or press F7 to toggle on and off).
@@ -27,7 +27,7 @@
This page is missing and should show up as a red link
diff --git a/home/wiki/Diagnostics/Javascript/Reference_tooltips.html b/home/wiki/Diagnostics/Javascript/Reference_tooltips.html
index 5103c8b5c..846c731ab 100644
--- a/home/wiki/Diagnostics/Javascript/Reference_tooltips.html
+++ b/home/wiki/Diagnostics/Javascript/Reference_tooltips.html
@@ -18,10 +18,10 @@
should be visible in the upper right corner of the page.
diff --git a/home/wiki/Diagnostics/Math.html b/home/wiki/Diagnostics/Math.html
index a000dc89f..c9abb7bde 100644
--- a/home/wiki/Diagnostics/Math.html
+++ b/home/wiki/Diagnostics/Math.html
@@ -18,7 +18,7 @@
X:1
diff --git a/home/wiki/Diagnostics/Xtns/Score/All.html b/home/wiki/Diagnostics/Xtns/Score/All.html
index d734027a3..6be333c72 100644
--- a/home/wiki/Diagnostics/Xtns/Score/All.html
+++ b/home/wiki/Diagnostics/Xtns/Score/All.html
@@ -21,13 +21,13 @@
Lilypond must be installed for these tests to work. See App/Xtn/Mediawiki/Score
\relative c' { f d f a d f e d cis a cis e a g f e }
diff --git a/home/wiki/Diagnostics/Xtns/Score/Lilypond_raw.html b/home/wiki/Diagnostics/Xtns/Score/Lilypond_raw.html
index 951d18b4d..04216eb0e 100644
--- a/home/wiki/Diagnostics/Xtns/Score/Lilypond_raw.html
+++ b/home/wiki/Diagnostics/Xtns/Score/Lilypond_raw.html
@@ -18,7 +18,7 @@
- Components and Tools
+ Components and Tools[edit]
XOWA is free software. It was built using free software and was made possible by free culture.
diff --git a/home/wiki/Help/Admin/Environment/Machine.html b/home/wiki/Help/Admin/Environment/Machine.html
index 7b36f019b..47274d52c 100644
--- a/home/wiki/Help/Admin/Environment/Machine.html
+++ b/home/wiki/Help/Admin/Environment/Machine.html
@@ -21,7 +21,7 @@
This page details the recommended environment for running XOWA.
For building wikis, XOWA works best on a recent-generation machine. For building English Wikipedia, XOWA works best with high-performance hardware.
diff --git a/home/wiki/Help/Contents.html b/home/wiki/Help/Contents.html
index 699d697bc..2dcdf5ad2 100644
--- a/home/wiki/Help/Contents.html
+++ b/home/wiki/Help/Contents.html
@@ -18,7 +18,7 @@
If you are multilingual, you can review a wiki in your native language for errors. Aside from English, my only other language competency is French, but that knowledge is several years old. Multilanguage testing has been sparse. The non-English language wikis were confirmed by eyeballing general form and structure, but actual content could not be confirmed.
XOWA currently uploads all files to archive.org. More help can always be provided in the following ways:
diff --git a/home/wiki/Help/Donate.html b/home/wiki/Help/Donate.html
index ff9985a38..ad28005cc 100644
--- a/home/wiki/Help/Donate.html
+++ b/home/wiki/Help/Donate.html
@@ -55,7 +55,7 @@
Thank you!
diff --git a/home/wiki/Help/Download_XOWA.html b/home/wiki/Help/Download_XOWA.html
index 431032c57..23531b2f6 100644
--- a/home/wiki/Help/Download_XOWA.html
+++ b/home/wiki/Help/Download_XOWA.html
@@ -24,7 +24,7 @@
For more details about the release, please see the Blog or the Change log
major
diff --git a/home/wiki/Help/FAQs.html b/home/wiki/Help/FAQs.html
index 90db4f724..b68659a96 100644
--- a/home/wiki/Help/FAQs.html
+++ b/home/wiki/Help/FAQs.html
@@ -48,13 +48,13 @@
- I've found a bug. How do I report it?
+ I've found a bug. How do I report it?[edit]
Report it through Github, Wikipedia or by email! See Help/Feedback
- How do you pronounce XOWA?
+ How do you pronounce XOWA?[edit]
The preferred pronunciation is "X' - O - WA". In IPA, it would be ɛksˈ ō wə.
@@ -63,7 +63,7 @@
An accepted pronunciation is "ZO' - WA". In IPA, it would be zō wə.
- Why are language links to other wikis not listed?
+ Why are language links to other wikis not listed?[edit]
Short answer: Set up the Wikidata wiki (www.wikidata.org). See Dashboard/Import/Online. After you install the Wikidata wiki, language links to other wikis will be listed at the bottom of the article.
@@ -72,7 +72,7 @@
Long answer: See App/Wiki_types/Wikidata
- Why do some pages have sections that overlap each other?
+ Why do some pages have sections that overlap each other?[edit]
Short answer: Images are necessary for some pages to show correctly. (for example, en.wiktionary.org/wiki/Main_Page).
@@ -81,13 +81,13 @@
Long answer: Some pages have divs that auto-size to their image. If the images are not downloaded, then the divs auto-size around nothing, causing a "collapsed" look. Unfortunately, since there is no image size info in the wikitext, there is little XOWA can do to "force" the div to the correct size.
- How do I print a page?
+ How do I print a page?[edit]
From the Main Menu, choose File -> Print!
- Why does <rss> show up?
+ Why does <rss> show up?[edit]
The <rss> tag is used on some wikis. For example, http://wikimediafoundation.org/wiki/Main_Page uses it in their "Recent Wikimedia blog posts"
@@ -96,7 +96,7 @@
XOWA doesn't implement the rss tag, because RSS feeds are not available offline. Note the tag is not hidden, because it could be more confusing to see empty space, rather than the literal rss tag.
- Why do some characters show up as boxes?
+ Why do some characters show up as boxes?[edit]
Certain articles will have non-English characters that will only be displayed correctly if the proper font is installed
diff --git a/home/wiki/Help/Features/Search/Build.html b/home/wiki/Help/Features/Search/Build.html
index fe8235173..4f2a8eb6a 100644
--- a/home/wiki/Help/Features/Search/Build.html
+++ b/home/wiki/Help/Features/Search/Build.html
@@ -59,7 +59,7 @@
Due to the nature of the PageRank algorithm, a lot of additional time and disk-space is needed. These requirements are especially dramatic for English Wikipedia:
@@ -156,13 +156,13 @@
With this in mind, XOWA offers the following options:
- Download the XOWA search databases from archive.org
+ Download the XOWA search databases from archive.org[edit]
Monthly versions of English Wikipedia's search databases will be posted to https://archive.org/edit/Xowa_enwiki_latest . You can just download a 2 GB dump of these databases and replace your copies.
- Use page-length instead of PageRank
+ Use page-length instead of PageRank[edit]
XOWA can use page-length and skip the pagelinks download (125+ GB) as well as the PageRank running time (8+ hours). However the generated results will not be as accurate as PageRank. Specifically, long pages like "List of ...." will have a high page score.
@@ -188,13 +188,13 @@
Note that 0 is the default value for this option.
- Use PageRank but limit to 1 iteration
+ Use PageRank but limit to 1 iteration[edit]
This option will still require a lot of disk space, but will limit the running time to a few hours. To use this option, do the same as above, but change "PageRank iteration count" to 1.
- Use PageRank but limit to 1000 iteration
+ Use PageRank but limit to 1000 iteration[edit]
This option will create the full version of PageRank search indexes. To use this option, do the same as above, but change "PageRank iteration count" to 1000.
@@ -203,7 +203,7 @@
Thanks to all those who took some time out to write about XOWA.
@@ -27,7 +27,7 @@
Also, many thanks to Anselm for gathering most of these links together (and several thanks to hidp123 as well).
Want to read what others have said above XOWA? Visit any one of the articles below in your preferred language.
diff --git a/home/wiki/Help/Overview.html b/home/wiki/Help/Overview.html
index 9d974256e..3379213aa 100644
--- a/home/wiki/Help/Overview.html
+++ b/home/wiki/Help/Overview.html
@@ -39,13 +39,13 @@
XOWA is an application for reading and editing wikis offline. It aims to provide full offline access to all content in every Wikimedia Foundation wiki.
XOWA should work with any dump that has been generated by MediaWiki software. It has been personally tested for over 200 wikis, including:
@@ -100,13 +100,13 @@
- XOWA is free software. The code is open source under the AGPLv3 license, and available to anyone for review or modification. See Help/License/Code for more information as well as https://github.com/gnosygnu/xowa.
+ XOWA is free software. The code is open source under the AGPLv3 license, and available to anyone for review or modification. See Help/License/Code for more information as well as https://github.com/gnosygnu/xowa.
XOWA advocates free content. All documentation and project artifacts are provided under the Creative Commons CC BY-NC-SA license. See Help/License/Docs for more information.
diff --git a/home/wiki/Help/Privacy/Android.html b/home/wiki/Help/Privacy/Android.html
index 103effb5f..d7c34436f 100644
--- a/home/wiki/Help/Privacy/Android.html
+++ b/home/wiki/Help/Privacy/Android.html
@@ -62,7 +62,7 @@
XOWA is commited to user privacy. Throughout the app, it follows these four guidelines:
@@ -82,13 +82,13 @@
- What permissions does XOWA require?
+ What permissions does XOWA require?[edit]
XOWA requires 5 permissions:
- Read External Storage (as of 2016-04-17)
+ Read External Storage (as of 2016-04-17)[edit]
@@ -99,7 +99,7 @@
- Internet (as of 2016-04-17)
+ Internet (as of 2016-04-17)[edit]
@@ -110,7 +110,7 @@
- Access Network State (as of 2016-04-17)
+ Access Network State (as of 2016-04-17)[edit]
@@ -118,7 +118,7 @@
- Write External Storage (as of 2016-06-19)
+ Write External Storage (as of 2016-06-19)[edit]
@@ -129,7 +129,7 @@
- Wake Lock (as of 2016-06-19)
+ Wake Lock (as of 2016-06-19)[edit]
@@ -137,7 +137,7 @@
- What information is stored in XOWA?
+ What information is stored in XOWA?[edit]
XOWA only collects user data related to application usage. For example:
@@ -163,7 +163,7 @@
XOWA collects no other data in the background.
- When does XOWA share this information?
+ When does XOWA share this information?[edit]
XOWA never shares user data. XOWA never uploads data. All data remains on your device unless you choose to do something with it.
@@ -183,7 +183,7 @@
No automatic emails are ever sent.
- How does XOWA store this information?
+ How does XOWA store this information?[edit]
XOWA is an offline app. However, it does connect to the internet to download dumps, images, css and other data. In nearly all cases, this internet access needs to be directly activated by the user. (i.e.: you click a link and XOWA goes off to download a dump)
@@ -130,7 +130,7 @@
- Mozilla browser data
+ Mozilla browser data[edit]
The embedded Mozilla browser generates its own history data and stores them in sqlite files in a user's profile directory. This includes names of clicked links (so the browser can highlight them).
@@ -158,7 +158,7 @@
Application logs are enabled by default. They are saved to files in the following directory: /xowa/user/anonymous/app/tmp.
@@ -167,7 +167,7 @@
Application logs can be disabled at Options/Security
Page history is enabled by default. The data is saved to the following file: /xowa/user/anonymous/app/data/history/page_history.csv.
@@ -176,7 +176,7 @@
Page history can be disabled at Options/Security
- Temporary HTML files
+ Temporary HTML files[edit]
All HTML for pages will be saved to and loaded from a temp directory on disk. The files are saved to the following directory: /xowa/user/anonymous/app/tmp/html. This is done for performance reasons related to SWT / XULRunner. See Options/Security
@@ -185,7 +185,7 @@
HTML can be changed to load directly from memory at Options/Security
Bookmarks are enabled by default. Note that no data is ever written automatically to the Bookmarks page, so one can simply not use the add feature.
@@ -194,7 +194,7 @@
If you wish to disable the feature completely (to prevent accidental clicks), then you can disable it at Options/Security
File download is disabled by default. All files are downloaded to the following directory: /xowa/file.
@@ -203,7 +203,7 @@
If you've enabled it, you can disable it at Options/Files
- Math images (LaTEX only)
+ Math images (LaTEX only)[edit]
Math images use MathJax by default, which does not generate temporary files.
@@ -215,7 +215,7 @@
You can always disable LaTEX again at Options/Math
Content applications are enabled by default. These applications may or may not generate their own temp files.
diff --git a/home/wiki/Help/Security.html b/home/wiki/Help/Security.html
index c242cb111..f05496ca3 100644
--- a/home/wiki/Help/Security.html
+++ b/home/wiki/Help/Security.html
@@ -18,7 +18,7 @@
Java vulnerabilities (and the resulting patches) are often in the news. However, most of these vulnerabilities affect machines with the Java browser plugin. A machine can have Java installed and be largely unaffected by these vulnerabilities -- so long as the Java browser plugin is disabled. If you want to check that the Java browser plugin is disabled, you can review the instructions at this link: http://www.java.com/en/download/help/disable_browser.xml
@@ -43,7 +43,7 @@
Finally, although XOWA uses Java and is a browser-based app, it does not use the Java browser plugin in any manner.
XOWA uses Javascript throughout the app for MathJax, sortable tables, reference tool-tips, and many other functions. Javascript is a versatile language for working with web pages, but that same versatility also makes it a vector for attack. There is always a possibility that malicious Javascript could be added to a wiki page, and that this malicious Javascript could make its way to your machine.
diff --git a/home/wiki/Main_Page.html b/home/wiki/Main_Page.html
index 687ad96d7..67b079791 100644
--- a/home/wiki/Main_Page.html
+++ b/home/wiki/Main_Page.html
@@ -82,13 +82,13 @@
Please note that this program is beta software. Although it is my best hope that you find this program functional and useful, I make no assurances regarding stability or fitness of purpose. For more details, see Help/License/Code.
If this is the first time you've run XOWA, then please choose from the following:
@@ -146,7 +146,7 @@
In addition, XOWA now supports creation of your own personal wiki.
- Build a wiki while online
+ Build a wiki while online[edit]
@@ -205,7 +205,7 @@
- Build a wiki while offline
+ Build a wiki while offline[edit]
@@ -213,7 +213,7 @@
- Download pre-built wikis within XOWA
+ Download pre-built wikis within XOWA[edit]
@@ -230,7 +230,7 @@
- Download pre-built wikis within a browser
+ Download pre-built wikis within a browser[edit]
@@ -244,7 +244,7 @@
- Creating a personal wiki
+ Creating a personal wiki[edit]
