- Setting up a wiki: Simple Wikipedia
+ Install a wiki automatically: Simple Wikipedia
+
+
+
+ Select XOWA from the Menu (button in upper left hand corner)
+
+
+ On the XOWA Wikis screen, press the Download button
+
+
+ Add Simple Wikipedia Articles to the Queue
+
+
+ Run the Queue
+
+
+ Select XOWA again from the Menu
+
+
+ Select simple.wikipedia.org
+
+
+
+ Install a wiki manually: Simple Wikipedia
-
- For a brief test, let's start with Simple Wikipedia.
-
- Download the html-only version on your desktop
+ Download the files
- Download the html-only version. This will not have any images. It's about 500 MB.
+ Download the articles. This will not have any images and will be about 300 MB.
- Move the files to your microSD card with a folder structure of \Android\data\org.xowa\[1]. Assuming your microSD card is attached as the X drive, you will have files like these:
+ Move the files to your micro-SD card with a folder structure of \Android\data\org.xowa\files\xowa\wiki\simple.wikipedia.org. Assuming your micro-SD card is attached as the X drive, you will have files like these:
+ Unzip the zip file to C:\xowa\wiki\simple.wikipedia.org. When you are done, you will have these files:
+
+
+
- Note that these files have the same names as those in the html download. These files should overwrite the existing files in the html download.
+ C:\xowa\wiki\simple.wikipedia.org\simple.wikipedia.org-file.xowa
+
+
+
+
+ Move the files to your micro-SD card with a folder. Following the example above, you will have files like these:
+
- Insert the microSD into your Android device
+ Insert the micro-SD into your Android device
Launch XOWA on your Android device
@@ -186,17 +184,17 @@
Press the XOWA button
- Press the blue plus image in the top right-hand corner of the grid
+ Press the download button in the top right-hand corner.
- If you're on Marshmallow, you will get a prompt to allow XOWA to read your SD card. Please allow it. For more information on XOWA's privacy policy, see Help/Privacy/Android
+ If you're on Marshmallow, you will get a prompt to allow XOWA to read your SD card. Please allow it. For more information on XOWA's privacy policy, see Help/Privacy/Android
- Go to the wiki folder on your SD card
+ Navigate to the wiki folder on your SD card
@@ -206,7 +204,7 @@
- Press the file with the XOWA icon. In this case it would be simple.wikipedia.org-text.xowa
+ Press the file with the XOWA icon. In this case, it would be simple.wikipedia.org-core.xowa
Press the link for simple.wikipedia.org on the XOWA page. You will be navigated to simple.wikipedia.org/wiki/Main_Page.
@@ -262,9 +260,6 @@
+ The \Android\data\org.xowa\ folder is strongly recommended.
+
+
+
+ Android Kit-Kat devices and up can only write to an external folder with this hierarchy: \Android\data\org.xowa\
+
+
+ XOWA Android currently does not write to any databases, but it will in the coming months. I'm working on an auto-update feature which will split a wiki into pieces and merge them together. The merging will require write permissions.
+
+
+
+ If you don't ever plan on using the auto-update feature, you can use any other path. For example, X:\xowa\wiki\simple.wikipedia.org\simple.wikipedia.org-text.xowa.
+
+
+ There is one catch: files in \Android\data\org.xowa\ will be deleted when ...
+
+
+
+ "Clear data" is selected from Settings -> XOWA -> Storage.
+
+
+ The app is uninstalled
+
+
+
+ This means that you can copy English Wikipedia to \Android\data\org.xowa\, and have 100 GB of data deleted when pressing "Clear data".
+
+
+ If you want to guard against accidental deletion, you should install instead somewhere else, like X:\xowa\. Note that this means you will not be able to use the auto-update feature within the Android app. You will be able to use it from the desktop app.
+
- The \Android\data\org.xowa\ folder is strongly recommended.
-
-
- Android Kit-Kat devices can only write to an external folder with this hierarchy: \Android\data\org.xowa\
-
-
- XOWA Android currently does not write to any databases, but it will in the coming months. I'm working on an auto-update "merge" facility which will split a wiki into pieces and merge them together. The merging will require write permissions.
-
-
-
-
- If you only want to have read-only access, you can use any other path. For example, X:\xowa\wiki\simple.wikipedia.org\simple.wikipedia.org-text.xowa .
-
diff --git a/home/wiki/App/Basics/Files.html b/home/wiki/App/Basics/Files.html
index be5cbd2bb..19f2e4670 100644
--- a/home/wiki/App/Basics/Files.html
+++ b/home/wiki/App/Basics/Files.html
@@ -83,7 +83,7 @@
XOWA sees a [[File]] link on a page.
- If image dbs are available, XOWA checks them to see if the image exists. To download an image db, see Dashboard/Image_databases
+ If image dbs are available, XOWA checks them to see if the image exists. To download an image db, see Dashboard/Image_databases
If image dbs are not available, or if the image is not in the image dbs, XOWA checks the Wikimedia servers
diff --git a/home/wiki/App/Bookmarks.html b/home/wiki/App/Bookmarks.html
index 62c2dcdcf..6f2f6198a 100644
--- a/home/wiki/App/Bookmarks.html
+++ b/home/wiki/App/Bookmarks.html
@@ -87,7 +87,7 @@
HTTP Server support
- Bookmarks can be viewed and edited in HTTP server mode. This has been tested with Firefox (39), Chrome (43), Safari (8) and Internet Explorer (9). If you have an older version and it doesn't work, please report it to Help/Feedback
+ Bookmarks can be viewed and edited in HTTP server mode. This has been tested with Firefox (39), Chrome (43), Safari (8) and Internet Explorer (9). If you have an older version and it doesn't work, please report it to Help/Feedback
+ As of v3.6.3, the Download Central page lists available wikis for download.
+
+
+ The advantages are as follows
+
+
+
+ Simple: Find a wiki, click on it, and it will imported.
+
+
+ Android and desktop: Listed wikis will work directly on Android as well as the desktop. These wikis are HTML dumps of XOWA pages.
+
+
+ Images included: Listed wikis will also include image databases. Previously, users would need to download image databases separately from archive.org.
+
+
+ Suspend and resume: Long tasks can be paused and resumed at a later point in time.
+
+
+
+ More wikis and functionality will be added to this page throughout 2016.
+
+
+ Technical details
+
+
+ Download Central works in the following manner:
+
+
+ Get list of wikis and files
+
+
+
+ Loads a list of wikis from C:\xowa\bin\any\xowa\addon\bldr\central\bldr_central.data_db.xowa
+
+
+ Loads a list of files for that wiki. For example, Simple Wikipedia will have 3 files
+
+
+ Xowa_simplewiki_2016-06_core.zip
+
+
+ Xowa_simplewiki_2016-06_file.zip
+
+
+ Xowa_simplewiki_2016-06_html.zip
+
+
+
+
+ Generates a "task" for each group of files and lists them in the "Available" table.
+
+
+
+ Download the files
+
+
+ Available tasks can be added to the Queue. When the Queue is run, Download Central will do the following:
+
+ target path: The file will be downloaded to C:\xowa\wiki\simple.wikipedia.org\tmp\bldr\
+
+
+
+
+ Verify the download with an MD5
+
+
+ Unzip the download
+
+
+ Verify the unzip with an MD5
+
+
+ Move the file to the wiki directory. For example, simple.wikipedia.org-core.xowa will be moved to C:\xowa\wiki\simple.wikipedia.org\simple.wikipedia.org-core.xowa
+
+
+ Register the file in the user's list of wikis (for "core" wiki file only)
+
+
+ Repeat again with each file until done.
+
+
+
+ Manual setup
+
+
+ Some users may not want to use Download Central. For example, users may have an alternate download manager which they prefer. Or they are using the HTTP Server, which currently does not support Download Central.
+
+
+ In these cases, manual setup is still possible in the following way:
+
+ Download the files for your wiki. These will generally follow the form of "Xowa_(wiki)_(date)_(type).zip". For example, see above for Simple Wikipedia file names.
+
+
+ Unzip the files to C:\xowa\wiki\simple.wikipedia.org\
+
+
+ For the desktop, just run XOWA. XOWA will automatically pick up the new wiki
+
+
+ For Android, copy the files to your SD Card. See Android Setup for a list of paths.
+
+
+
+ Existing monthly update users of the English Wikipedia v2b images
+
+
+ This section only applies to users who have been manually downloading the monthly updates for English Wikipedia
+
+
+ No need to redownload the images in Download Central
+
+
+ The Download Central image databases are the same as the existing ones on archive.org. They only differ in the following ways:
+
+
+
+ They are broken up into 1 file per zip instead of 3 or 4 files per zip
+
+
+ They have an md5 file.
+
+
+
+ If you are up-to-date with your monthly updates, all you need to do is download the update for 2016-06. For example, let's say you downloaded the initial v2b batch:
+
+ At this point you will have exactly the same files as those in Download Central
+
+
+ Download Central should be used for 2016-07 and future monthly updates
+
+
+ For next month (and future months), you should download the monthly update through Download Central. There will be a new task called "English Wikipedia - Image Update (2016-07)". You will just need to download this item, and you'll be up-to-date.
+
+
+ Of course, you will still be able to download them manually from archive.org. But as shown by the section above, this can be quite complicated.
+
+ The Download Central page lists wikis that can be downloaded from archive.org.
+
+
+
+ Simple: Find a wiki, click on it, and it will imported.
+
+
+ Android-ready: Listed wikis will work directly on Android
+
+
+ Images included: Listed wikis will also include image databases. The options below require downloading images separately.
+
+
+ Fewer selection: There are currently only a handful of wikis. More will be generated throughout 2016. If you need a specific wiki, please contact me by the Feedback page.
+
- The Import online page lists 800+ wikis that can be imported by clicking on a link.
+ The Import online page lists 800+ wikis that can be imported by clicking on a link.
@@ -38,7 +82,7 @@
Import offline by script
- The Import offline page can generate a script that will import a wiki.
+ The Import offline page can generate a script that will import a wiki.
@@ -49,7 +93,7 @@
Import by command-line
- The Dev/Command-line page offers instructions on importing through the command-line.
+ The Dev/Command-line page offers instructions on importing through the command-line.
diff --git a/home/wiki/App/Search.html b/home/wiki/App/Search.html
index da70b864c..d54e4a1a2 100644
--- a/home/wiki/App/Search.html
+++ b/home/wiki/App/Search.html
@@ -559,7 +559,7 @@
By default, XOWA returns results sorted by "page length descending". In other words, the largest page would be the first in the list and the smallest page would be the last.
- If a wiki is built with PageRank, or if a wiki is downloaded from archive.org, then the results will be sorted by "PageRank descending". See Options/Search for enabling PageRank.
+ If a wiki is built with PageRank, or if a wiki is downloaded from archive.org, then the results will be sorted by "PageRank descending". See Options/Search for enabling PageRank.
@@ -102,6 +105,12 @@
The embedded JRE uses functionality within the exe which in turn was built by launch4j. There is no specific code in XOWA to handle this function. Any issues with standalone JRE functionality will probably be resolvable at the launch4j level.
+ If you don't want to install Java, you can copy it from an existing machine, or download a portable package. See App/Setup/Flash card
+
On Debian Linux systems you can do sudo apt-get install openjdk-7-jre
diff --git a/home/wiki/App/UI/Menus.html b/home/wiki/App/UI/Menus.html
index 013b1d7e8..47fab2754 100644
--- a/home/wiki/App/UI/Menus.html
+++ b/home/wiki/App/UI/Menus.html
@@ -32,7 +32,7 @@
These menus can also be customized using the source at Options/Menus
- Note that internationalization (translation by language) is only supported for German. Other languages can be supported, but translations are needed! See Help/Feedback.
+ Note that internationalization (translation by language) is only supported for German. Other languages can be supported, but translations are needed! See Help/Feedback.
diff --git a/home/wiki/App/Wiki_types/Wikia.com.html b/home/wiki/App/Wiki_types/Wikia.com.html
index 5b73d5b28..7bda8813b 100644
--- a/home/wiki/App/Wiki_types/Wikia.com.html
+++ b/home/wiki/App/Wiki_types/Wikia.com.html
@@ -114,7 +114,7 @@
XOWA will try to implement these custom extensions in the future, but due to time constraints, they will be prioritized after Wikimedia extensions.
- If you have an extension that you would like to see supported, please contact me through Help/Feedback and let me know the wiki and the extension. Depending on number of requests and difficulty of implementation, I will try to include support for it.
+ If you have an extension that you would like to see supported, please contact me through Help/Feedback and let me know the wiki and the extension. Depending on number of requests and difficulty of implementation, I will try to include support for it.
@@ -138,7 +138,7 @@
You can refer to this thread for instructions on creating an inverted-colors css for Wikimedia wikis
- If you create a css that matches the wikia.com one and would like it to be part of XOWA's release, please contact me via Help/Feedback
+ If you create a css that matches the wikia.com one and would like it to be part of XOWA's release, please contact me via Help/Feedback
- As of v0.12.1, XOWA now includes an HTTP server in addition to a TCP server. The TCP server is used by the Firefox Add-On (See App/Xtn/Browser/XOWA_viewer).
+ As of v0.12.1, XOWA now includes an HTTP server in addition to a TCP server. The TCP server is used by the Firefox Add-On (See App/Xtn/Browser/XOWA_viewer).
If you are using Firefox, the Firefox Add-On is the recommended solution for using XOWA within a browser. However, if you want to use XOWA from another browser (for example, Google Chrome) or across the network, you will want to use the HTTP server instead.
diff --git a/home/wiki/App/Xtn/Browser/XOWA_viewer.html b/home/wiki/App/Xtn/Browser/XOWA_viewer.html
index 7bbb0073a..42aec8bdd 100644
--- a/home/wiki/App/Xtn/Browser/XOWA_viewer.html
+++ b/home/wiki/App/Xtn/Browser/XOWA_viewer.html
@@ -83,6 +83,9 @@
Set the jar location for "extensions.xowa_viewer.xowa_app" in about:config. See Config below
- By default, anything that matches a rule (has a score > 0) will be excluded. Note that this exclude number can be raised from 0 to something higher like 100. See Options/Import_Dansguardian
+ By default, anything that matches a rule (has a score > 0) will be excluded. Note that this exclude number can be raised from 0 to something higher like 100. See Options/Import_Dansguardian
- The math module uses MathJax by default. You can change it to LaTEX by navigating to Options/Math and choosing LaTeX
+ The math module uses MathJax by default. You can change it to LaTEX by navigating to Options/Math and choosing LaTeX
Test
diff --git a/home/wiki/App/Xtn/Mediawiki/Math/Latex/Mac_OS_X.html b/home/wiki/App/Xtn/Mediawiki/Math/Latex/Mac_OS_X.html
index 0aa45f8a3..26d06df90 100644
--- a/home/wiki/App/Xtn/Mediawiki/Math/Latex/Mac_OS_X.html
+++ b/home/wiki/App/Xtn/Mediawiki/Math/Latex/Mac_OS_X.html
@@ -18,7 +18,7 @@
- XOWA currently has no instructions for Mac OS X. You can help by installing LaTEX and dvipng on our machine and posting your instructions. Please see Help/Feedback.
+ XOWA currently has no instructions for Mac OS X. You can help by installing LaTEX and dvipng on our machine and posting your instructions. Please see Help/Feedback.
- The math module uses MathJax by default. You can change it to LaTEX by navigating to Options/Math and choosing LaTeX
+ The math module uses MathJax by default. You can change it to LaTEX by navigating to Options/Math and choosing LaTeX
+ The PC app is a major release. It has a new Download page, can now read Android HTML databases by default, and includes many minor fixes
+
+
+ The Android app is a major release. It also has a new Download page, as well as some minor changes.
+
+
+ The Server app is a major release. It can read Android HTML databases by default, and has a fix for the broken Search.
+
+
+ (PC & Android) New Download Central to download HTML dumps and images
+
+
+ Download Central is the major feature of the release. This is an in-app downloader that can download wikis for both Android or desktop. It can download images as well.
+
+
+ For v3.6.3, there are only two wikis: Simple Wikipedia and English Wikipedia. More wikis will be added every week throughout 2016. Next week, v3.6.4 should have other English wikis, like English Wiktionary and Wikisource.
+
+
+ Going forward, Download Central will be the primary vehicle to get XOWA wikis. It provides a simple way to import wikis. It eliminates any confusion about which files to download and where to copy them. Monthly updates for English Wikipedia will be published here as well.
+
+ (PC & Server) Android HTML dumps are now usable
+
+
+ This is the other major feature of the release. Previously, the app could only read wikitext dumps. Now, it can read the XOWA Android HTML dumps. This has a few key benefits:
+
+
+
+ One micro-SD card: many platforms: The same micro-SD card can be used to read XOWA on Windows, Linux, Mac OS X, Raspberry PI or Android
+
+
+ Fast page loads: The app no longer needs to generate HTML from the wikitext. It can just load the HTML directly. This will be significantly faster. For example, a page like Earth might have taken 5 seconds to load. Now it loads in 1 second (or less).
+
+
+ Wikidata no longer required: The HTML dumps no longer need Wikidata, which took up an additional 32 GB of space. Previously, Wikidata (www.wikidata.org) needed to be imported, or else some data would be missing.
+
+
+
+ However, there are drawbacks as well:
+
+
+
+ Missing features: The HTML dumps currently do not support these features:
+
+
+ Table of Contents: Android generates Table of Contents in a different manner
+
+
+ Redlinks: This feature still needs to be implemented.
+
+
+ Links in other languages: Wikidata is still needed for this information
+
+
+ Categories (partially): Categories are dynamically rendered. The HTML dumps includes the first 200 items in a category, but if there are more, they won't be available
+
+
+ Other omissions: Image Map and Gallery were found to be broken for 2016-06 English Wikipedia. They are fixed for future releases. However, there will probably be other items that will be discovered as well.
+
+
+
+
+
+
+ Plans: Each of these features will be implemented over the course of 2016. The end-goal is to have the HTML dumps produce the same output as the wikitext dumps.
+
+
+
+
+ Larger size: The HTML dumps are larger than the wikitext (approximately 30 GB vs 20 GB).
+
+
+
+
+ Plans: This will be whittled down over releases, though it's unlikely that the HTML dumps will ever be smaller than 25 GB.
+
+
+
+
+ Requires separate post-processing generation step: The wikitext dumps were automatically generated by downloading an XML dump. The HTML dumps requires another post-processing step that is not simple to run (See: Dev/Command-line/Dumps)
+
+
+
+
+ Plans: This may be simplified with a "Generate HTML dump" button in the future, but generating an HTML dump for English Wikipedia will probably be a resource-intensive task
+
+
+
+ Finally, a few notes on wikitext dumps versus HTML dumps.
+
+
+
+ More work on HTML dumps in the future: Going forward, a lot of development work will go into the HTML dumps. This is necessary as the wikitext dumps are too slow for Android.
+
+
+ HTML dumps will be uploaded to archive.org: Previously, Wikitext dumps were uploaded to archive.org. Now it will be HTML dumps instead.
+
+
+ Wikitext dump support is not going away: Wikitext dumps will still be supported and used. Note that they are still a critical precursor to HTML dumps. (HTML dumps can't be produced without them).
+
+
+
+ (PC & Android & Server) Search now reduces importance of short pages
+
+
+ The new XOWA Search Engine uses PageRank to rate pages by importance. Although this works well for Wikipedia, it sometimes overrates pages which exist for encyclopedic book-keeping.
+
+
+ For example, a lot of Wikipedia pages will have a small box called "Authority Control" at the bottom of the page. This box will have links to other pages like https://en.wikipedia.org/wiki/Integrated_Authority_Control If a million pages have this Integrated Authority Control link, then PageRank rates this page highly. ("1 million pages link to it!") However, the page itself is fairly short, and is not really one of the most important articles in Wikipedia (it would score higher than India, Insect, Italy, etc).
+
+
+ v3.6.3 tries to reduce the importance of these pages if these articles are "short". This heuristic was already present in the previous versions of the search engine, but has been further tweaked.
+
+
+ (Server) Fix for broken Search
+
+
+ This was kindly reported by thombles here: https://github.com/gnosygnu/xowa/issues/59 . The new Search Engine in 2016-03 broke the HTTP Server search. This was fixed in this release.
+
+
+ (PC) Minor fixes (Database, HTML Dump, Search, Special, Parser)
+
+
+ These can be described briefly as follows:
+
+
+
+ Database: Small wikis now generate a "core.xowa" file in addition to a "text.xowa" file. Previously, they only generated a "text.xowa" file.
+
+
+ HTML dump: Image Map and Gallery weren't working correctly. Note that these are still broken in the current 2016-06 dump, but will be fixed in the 2016-07 one.
+
+
+ Search: A few searches would be blank if the page also existed in a different namespace (for example, dokuwiki)
+
+
+ Special: Special page names can now be case-insensitive (Special:RANDOM) or use native-language terms (Spezial:Zufällige_Seite)
+
+
+ Parser: A handful of script errors around redirect links and country flags
+
+
+
+ (Android) Minor changes (more Special pages: redesigned UI for special pages, HTML Page Title, flat icon)
+
+
+ These can also be described briefly as follows:
+
+
+
+ More Special pages: The following two pages have been added:
+
+
+ Wiki Info: Shows information about the wiki, including size and location. Also allows deletion of the wiki. Available by doing: Menu -> XOWA -> Info icon
+
+
+ Log: Shows log information for troubleshooting. Available by doing: Menu -> Settings -> Logs
+
+
+
+
+ Redesigned UI for special pages: Special pages now use a common look and feel. This involves shared CSS, more icons, and a simple "help" panel. Also, they no longer show the footer (view page in browser; last modified, CC Content)
+
+
+ HTML Page Title: The Page Title used to be an Android TextView widget. Now it's part of the HTML document. This makes resizing the page much nicer (the widget used to jump around when the page was resized)
+
+
+ Flat icon: XOWA now has a flat icon
+
+
+
+ (Wikis) English Wikipedia (2016-06) and Simple Wikipedia (2016-06)
+
- The rest are more trivial in comparison. You can check the Change_log for more detail.
+ The rest are more trivial in comparison. You can check the Change_log for more detail.
Image packages for Serbian, Malay and Bulgarian wikis
@@ -999,7 +999,7 @@
- The rest are more trivial in comparison. You can check the Change_log for more detail.
+ The rest are more trivial in comparison. You can check the Change_log for more detail.
Image packages for Serbian, Malay and Bulgarian wikis
@@ -1465,7 +1465,7 @@
Various minor fixes
- There were a lot of other minor fixes in v2.8.1. Most of these are parser related, but there are a few interesting items under the change section. Please have a look at the Change_log
+ There were a lot of other minor fixes in v2.8.1. Most of these are parser related, but there are a few interesting items under the change section. Please have a look at the Change_log
Next release: v2.8.2
@@ -1540,7 +1540,7 @@
Minor miscellaneous fixes
- There were a bunch of minor fixes. None of these are worth further explanation, so please take a quick look at the Change_log
+ There were a bunch of minor fixes. None of these are worth further explanation, so please take a quick look at the Change_log
New javascript libraries
@@ -1648,13 +1648,13 @@
I finished uploading the files for English Wikipedia. Note that these files are just like the 2015-04 set, except that the max file size is 1.5 GB instead of 3 GB. Android can't use 3 GB files.
- Unfortunately, right now, there are 3 types of sets for English Wikipedia: v1, v2a and v2b. See App/Import/English_Wikipedia for more details. Users are strongly encouraged to download the new 2015-06 set (v2b), especially if they're going to use Android. However, I will continue to support monthly updates for v1 and v2a over the next year.
+ Unfortunately, right now, there are 3 types of sets for English Wikipedia: v1, v2a and v2b. See App/Import/English_Wikipedia for more details. Users are strongly encouraged to download the new 2015-06 set (v2b), especially if they're going to use Android. However, I will continue to support monthly updates for v1 and v2a over the next year.
For more information on setting up English Wikipedia, see App/Xtn/Android
- XOWA droid can now run a complete version of English Wikipedia. Of course, I'll be making many more changes in the upcoming months. If you come across any bugs or have any suggestions, feel free to drop by and give me some feedback as per Help/Feedback
+ XOWA droid can now run a complete version of English Wikipedia. Of course, I'll be making many more changes in the upcoming months. If you come across any bugs or have any suggestions, feel free to drop by and give me some feedback as per Help/Feedback
Fix for wikis not working because of old image databases
@@ -1845,7 +1845,7 @@
v2.6.2 now prefers v1 over v2. This should automatically fix anyone who encountered the problem above. Of course, if a v1 user moves to v2, then they would have to move / delete the v1 databases in order to see v2.
- If you find your images are still not working, please post as per Help/Feedback
+ If you find your images are still not working, please post as per Help/Feedback
Mac OS X now defaults to WebKit instead of XULRunner
@@ -1952,7 +1952,7 @@
Release: v2.5.4.1 (2015-05-25 01:15 Sun)
- v2.5.4.1 is a significant release. In brief, it involved a rewrite of the online file downloading system to use the same system as the offline version. It also includes instructions for building the image databases on Dashboard/Image_databases as well as an Android alpha. It may be worthwhile to go through the items in Change_log
+ v2.5.4.1 is a significant release. In brief, it involved a rewrite of the online file downloading system to use the same system as the offline version. It also includes instructions for building the image databases on Dashboard/Image_databases as well as an Android alpha. It may be worthwhile to go through the items in Change_log
- v2.4.4.1 introduces a multi-wiki search feature. The configuration is a bit difficult, but it should be flexible enough to handle most scenarios. See Options/Search. I also made a few more improvements to the general Search behavior. There are also some important incremental fixes from earlier this week.
+ v2.4.4.1 introduces a multi-wiki search feature. The configuration is a bit difficult, but it should be flexible enough to handle most scenarios. See Options/Search. I also made a few more improvements to the general Search behavior. There are also some important incremental fixes from earlier this week.
For images, the last part of German is uploading, and I plan to upload Czech tonight or tomorrow.
@@ -2074,7 +2074,7 @@
These changes involved a lot of rewrite of database code over the past few weeks. I've done testing on my side, but if you notice any issues, please report them to https://sourceforge.net/p/xowa/discussion/general/
diff --git a/home/wiki/Blog/2016-01.html b/home/wiki/Blog/2016-01.html
index 925e8004a..51ae68c90 100644
--- a/home/wiki/Blog/2016-01.html
+++ b/home/wiki/Blog/2016-01.html
@@ -31,7 +31,7 @@
2016-05
This item is self-explanatory. The XOWA Android app is getting more stable, so I felt it would be time to document the generation of the HTML databases.
diff --git a/home/wiki/Blog/2016-02.html b/home/wiki/Blog/2016-02.html
index 2fff25d79..aa922e570 100644
--- a/home/wiki/Blog/2016-02.html
+++ b/home/wiki/Blog/2016-02.html
@@ -31,7 +31,7 @@
2016-05
2016-03
diff --git a/home/wiki/Blog/2016-04.html b/home/wiki/Blog/2016-04.html
index acfd56c5d..92fd85213 100644
--- a/home/wiki/Blog/2016-04.html
+++ b/home/wiki/Blog/2016-04.html
@@ -162,7 +162,7 @@
The images are an update to the 2015-09 set. If you already have the 2015-09 set, just download the 2016-04 update: https://archive.org/download/Xowa_dewiki_latest/Xowa_dewiki_2016-04-07_file_update.7z
- For Android, download all the de.wikipedia.org files in Android/Setup
+ For Android, download all the de.wikipedia.org files in Android/Setup
+ The PC app is a major release. It has a new Download page, can now read Android HTML databases by default, and includes many minor fixes
+
+
+ The Android app is a major release. It also has a new Download page, as well as some minor changes.
+
+
+ The Server app is a major release. It can read Android HTML databases by default, and has a fix for the broken Search.
+
+
+ (PC & Android) New Download Central to download HTML dumps and images
+
+
+ Download Central is the major feature of the release. This is an in-app downloader that can download wikis for both Android or desktop. It can download images as well.
+
+
+ For v3.6.3, there are only two wikis: Simple Wikipedia and English Wikipedia. More wikis will be added every week throughout 2016. Next week, v3.6.4 should have other English wikis, like English Wiktionary and Wikisource.
+
+
+ Going forward, Download Central will be the primary vehicle to get XOWA wikis. It provides a simple way to import wikis. It eliminates any confusion about which files to download and where to copy them. Monthly updates for English Wikipedia will be published here as well.
+
+ (PC & Server) Android HTML dumps are now usable
+
+
+ This is the other major feature of the release. Previously, the app could only read wikitext dumps. Now, it can read the XOWA Android HTML dumps. This has a few key benefits:
+
+
+
+ One micro-SD card: many platforms: The same micro-SD card can be used to read XOWA on Windows, Linux, Mac OS X, Raspberry PI or Android
+
+
+ Fast page loads: The app no longer needs to generate HTML from the wikitext. It can just load the HTML directly. This will be significantly faster. For example, a page like Earth might have taken 5 seconds to load. Now it loads in 1 second (or less).
+
+
+ Wikidata no longer required: The HTML dumps no longer need Wikidata, which took up an additional 32 GB of space. Previously, Wikidata (www.wikidata.org) needed to be imported, or else some data would be missing.
+
+
+
+ However, there are drawbacks as well:
+
+
+
+ Missing features: The HTML dumps currently do not support these features:
+
+
+ Table of Contents: Android generates Table of Contents in a different manner
+
+
+ Redlinks: This feature still needs to be implemented.
+
+
+ Links in other languages: Wikidata is still needed for this information
+
+
+ Categories (partially): Categories are dynamically rendered. The HTML dumps includes the first 200 items in a category, but if there are more, they won't be available
+
+
+ Other omissions: Image Map and Gallery were found to be broken for 2016-06 English Wikipedia. They are fixed for future releases. However, there will probably be other items that will be discovered as well.
+
+
+
+
+
+
+ Plans: Each of these features will be implemented over the course of 2016. The end-goal is to have the HTML dumps produce the same output as the wikitext dumps.
+
+
+
+
+ Larger size: The HTML dumps are larger than the wikitext (approximately 30 GB vs 20 GB).
+
+
+
+
+ Plans: This will be whittled down over releases, though it's unlikely that the HTML dumps will ever be smaller than 25 GB.
+
+
+
+
+ Requires separate post-processing generation step: The wikitext dumps were automatically generated by downloading an XML dump. The HTML dumps requires another post-processing step that is not simple to run (See: Dev/Command-line/Dumps)
+
+
+
+
+ Plans: This may be simplified with a "Generate HTML dump" button in the future, but generating an HTML dump for English Wikipedia will probably be a resource-intensive task
+
+
+
+ Finally, a few notes on wikitext dumps versus HTML dumps.
+
+
+
+ More work on HTML dumps in the future: Going forward, a lot of development work will go into the HTML dumps. This is necessary as the wikitext dumps are too slow for Android.
+
+
+ HTML dumps will be uploaded to archive.org: Previously, Wikitext dumps were uploaded to archive.org. Now it will be HTML dumps instead.
+
+
+ Wikitext dump support is not going away: Wikitext dumps will still be supported and used. Note that they are still a critical precursor to HTML dumps. (HTML dumps can't be produced without them).
+
+
+
+ (PC & Android & Server) Search now reduces importance of short pages
+
+
+ The new XOWA Search Engine uses PageRank to rate pages by importance. Although this works well for Wikipedia, it sometimes overrates pages which exist for encyclopedic book-keeping.
+
+
+ For example, a lot of Wikipedia pages will have a small box called "Authority Control" at the bottom of the page. This box will have links to other pages like https://en.wikipedia.org/wiki/Integrated_Authority_Control If a million pages have this Integrated Authority Control link, then PageRank rates this page highly. ("1 million pages link to it!") However, the page itself is fairly short, and is not really one of the most important articles in Wikipedia (it would score higher than India, Insect, Italy, etc).
+
+
+ v3.6.3 tries to reduce the importance of these pages if these articles are "short". This heuristic was already present in the previous versions of the search engine, but has been further tweaked.
+
+
+ (Server) Fix for broken Search
+
+
+ This was kindly reported by thombles here: https://github.com/gnosygnu/xowa/issues/59 . The new Search Engine in 2016-03 broke the HTTP Server search. This was fixed in this release.
+
+
+ (PC) Minor fixes (Database, HTML Dump, Search, Special, Parser)
+
+
+ These can be described briefly as follows:
+
+
+
+ Database: Small wikis now generate a "core.xowa" file in addition to a "text.xowa" file. Previously, they only generated a "text.xowa" file.
+
+
+ HTML dump: Image Map and Gallery weren't working correctly. Note that these are still broken in the current 2016-06 dump, but will be fixed in the 2016-07 one.
+
+
+ Search: A few searches would be blank if the page also existed in a different namespace (for example, dokuwiki)
+
+
+ Special: Special page names can now be case-insensitive (Special:RANDOM) or use native-language terms (Spezial:Zufällige_Seite)
+
+
+ Parser: A handful of script errors around redirect links and country flags
+
+
+
+ (Android) Minor changes (more Special pages: redesigned UI for special pages, HTML Page Title, flat icon)
+
+
+ These can also be described briefly as follows:
+
+
+
+ More Special pages: The following two pages have been added:
+
+
+ Wiki Info: Shows information about the wiki, including size and location. Also allows deletion of the wiki. Available by doing: Menu -> XOWA -> Info icon
+
+
+ Log: Shows log information for troubleshooting. Available by doing: Menu -> Settings -> Logs
+
+
+
+
+ Redesigned UI for special pages: Special pages now use a common look and feel. This involves shared CSS, more icons, and a simple "help" panel. Also, they no longer show the footer (view page in browser; last modified, CC Content)
+
+
+ HTML Page Title: The Page Title used to be an Android TextView widget. Now it's part of the HTML document. This makes resizing the page much nicer (the widget used to jump around when the page was resized)
+
+
+ Flat icon: XOWA now has a flat icon
+
+
+
+ (Wikis) English Wikipedia (2016-06) and Simple Wikipedia (2016-06)
+
- Change log items are divided into the following categories:
+ Change log items are divided into the following high-level categories:
+
+
+
+ Wiki: New Wikis to be downloaded from archive.org
+
+
+ PC: Changes related to the XOWA application on Windows, Linux, and Mac OS X personal computers.
+
+
+ Android: Changes related to Android OS phones, tablets, and related devices
+
+
+ Server: Changes related to the XOWA HTTP Server on Windows, Linux, Mac OS X, and Raspberry PI machines
+
+
+ Doc: Documentation changes in home wiki and http://xowa.org
+
+
+ Dev: Code-related changes. Will not be noticeable.
+
+
+
+ Note that PC changes will probably also affect Andriod and Server. All three apps share the same code-base.
+
+
+ Sub-categories
+
+
+ For PC, Android, and Server, change log items are further divided into the following sub-categories:
@@ -160,28 +223,293 @@
trivial: Trivial change, fix or addition. Probably unnoticeable.
-
- package: New wikis / images uploaded to archive.org
-
-
- doc: Documentation changes. Primarily in home wiki
-
-
- dev: Code-related changes. Will not be noticeable.
-
- The most important categories to review are major and package. The other categories may be skipped due to lower importance (if they were more important, they would be bumped up to major).
+ The most important category to review is major. The other categories may be skipped due to lower importance (if they were more important, they would be bumped up to major).
major.fix
@@ -1053,7 +1381,7 @@
Core: Parse decimals using US locale, not user locale. Resolves extremely wide pie charts on many de.w pages. {detected by markusmaresch} See: https://de.wikipedia.org/wiki/Hausmannstätten
- Luaj: Use HOUR_OF_DAY for os.time, not HOUR (resolves hour off by 12 for os.time calls). See: Diagnostics/Scribunto/Luaj
+ Luaj: Use HOUR_OF_DAY for os.time, not HOUR (resolves hour off by 12 for os.time calls). See: Diagnostics/Scribunto/Luaj
- Command-line: Expand instructions for generating HTML dumps. See: Dev/Command-line/Dumps
+ Command-line: Expand instructions for generating HTML dumps. See: Dev/Command-line/Dumps
- (add) File: English Wikipedia image database updated for 2013-12-02. See: Dashboard/Image_databases
+ (add) File: English Wikipedia image database updated for 2013-12-02. See: Dashboard/Image_databases
(change) Parser: English Wikipedia pages (2013-12-02) with {{Dead_link}} no longer fail. See: http://en.wikipedia.org/wiki/Wikia
@@ -576,7 +576,7 @@
(fix) [broken since:v0.11.1] Html: Redlinks does not work when using "Back" / "Forward" {detected by Schnark; hidp123}.
diff --git a/home/wiki/Change_log/2014.html b/home/wiki/Change_log/2014.html
index ce4870c3a..6e10d7edc 100644
--- a/home/wiki/Change_log/2014.html
+++ b/home/wiki/Change_log/2014.html
@@ -706,7 +706,7 @@
- Module.Popups: Reduce hide window time from 600 ms back to 400 ms. See: Options/Popups
+ Module.Popups: Reduce hide window time from 600 ms back to 400 ms. See: Options/Popups
Performance: Add option to load html from url instead of from memory. See: Options/Security
@@ -1833,19 +1833,19 @@
- Module.Popups: Add performance optimization for English Wikipedia popups; EX:See "Template keeplist". See: Options/Popups
+ Module.Popups: Add performance optimization for English Wikipedia popups; EX:See "Template keeplist". See: Options/Popups
Module.Popups: Add XowaPopupHistory button at bottom of popup; EX:hover over sundial icon.
- Module.Popups: Increase defaults for number of words shown. See: Options/Popups
+ Module.Popups: Increase defaults for number of words shown. See: Options/Popups
- Module.Popups: Increase hover show time from 400 to 600 ms (affects number of accidental hovers while scrolling through page). See: Options/Popups
+ Module.Popups: Increase hover show time from 400 to 600 ms (affects number of accidental hovers while scrolling through page). See: Options/Popups
@@ -1959,13 +1959,13 @@
Module.Popups: Add wiki domain when hovering over interwiki pages; EX:en.w:Earth -> hover over link to en.q:Earth -> show "Earth wiki:en.wikiquote.org" {suggested by Schnark}. See: https://en.wikipedia.org/wiki/Earth
- Module.Popups: Add option to skip evaluation of long templates; EX:See "Template token max". See: Options/Popups
+ Module.Popups: Add option to skip evaluation of long templates; EX:See "Template token max". See: Options/Popups
- Module.Popups: Add option to show popups in namespaces only; EX:See "Allowed namespaces" {suggested by Schnark}. See: Options/Popups
+ Module.Popups: Add option to show popups in namespaces only; EX:See "Allowed namespaces" {suggested by Schnark}. See: Options/Popups
- Module.Popups: Add option to scan forward additional words to stop at header; EX:See "Scan forward for header" {suggested by Schnark}. See: Options/Popups
+ Module.Popups: Add option to scan forward additional words to stop at header; EX:See "Scan forward for header" {suggested by Schnark}. See: Options/Popups
Scribunto: Handle new package.lua (affects location map not loading on cities / countries); EX:package.lua. See: https://en.wikipedia.org/wiki/Paris
@@ -4026,7 +4026,7 @@
Math: Note that MikTeX may fail to update images dynamically for first page {detected by William}.
- Help.Contents: Redesign layout of Help:Contents. See: Help/Contents
+ Help.Contents: Redesign layout of Help:Contents. See: Help/Contents
- Help.Download: Fix links for commonswiki (was pointing to enwikisource) {detected by Miles}. See: Dashboard/Image_databases
+ Help.Download: Fix links for commonswiki (was pointing to enwikisource) {detected by Miles}. See: Dashboard/Image_databases
- Doc: Add details for installing Firefox Addon for Pale Moon {suggested by pirate}. See: App/Xtn/Browser/XOWA_viewer
+ Doc: Add details for installing Firefox Addon for Pale Moon {suggested by pirate}. See: App/Xtn/Browser/XOWA_viewer
Doc: Add details for dansguardian filter. See: App/Xtn/Import/Dansguardian
@@ -1664,7 +1664,7 @@
SWT: Update SWT to v4.5 (affects printing not working); EX:/bin/your_os_name/swt/. See: Dev/SWT
- Search: Support search over multiple wikis. See: Options/Search
+ Search: Support search over multiple wikis. See: Options/Search
@@ -2485,7 +2485,7 @@
- Database: Rename extension from .sqlite3 to .xowa. See: Dev/Design/Database
+ Database: Rename extension from .sqlite3 to .xowa. See: Dev/Design/Database
+
+
\ No newline at end of file
diff --git a/home/wiki/Dashboard/Image_databases.html b/home/wiki/Dashboard/Image_databases.html
index 25675fa95..e9aad9fa1 100644
--- a/home/wiki/Dashboard/Image_databases.html
+++ b/home/wiki/Dashboard/Image_databases.html
@@ -227,6 +227,38 @@
+
+ ^Choose one of the following: (default is checked)
+
+
+ checked: (default) Read tab uses HTML databases. Note that this will be faster, but there may be some inaccuracies. (These inaccuracies are being worked on)
+
+
+ unchecked: Read tab uses Wikitext. Note that this will be slower, but more accurate.
+
+
+
+
+ ^Choose one of the following: (default is Shown)
+
+
+ Shown: (default) HTML tab shows actual HTML.
+
+
+ Saved for HTML DB: HTML tab shows HTML as it will be saved for the HTML database. Note that this is for developer purposes only.
+
Save