gristlabs_grist-core/sandbox/grist/imports/fixtures
Dmitry S d5a4605d2a (core) Improve encoding detection for csv imports, and make encoding an editable option.
Summary:
- Using a sample of data was causing poor detection if the sample were
  cut mid-character. Switch to using line-based detection.
- Add a simple option for changing encoding. No convenient UI is offered
  since config UI is auto-generated, but this at least makes it possible to
  recover from bad guesses.
- Upgrades chardet library for good measure.

- Also fixes python3-building step, to more reliably rebuild Python
  dependencies when requirements3.* files change.

Test Plan:
Added a python-side test case, and a browser test that encodings can
be switched, errors are displayed, and wrong encodings fail recoverably.

Reviewers: alexmojaki

Reviewed By: alexmojaki

Differential Revision: https://phab.getgrist.com/D3979
2023-08-24 09:50:52 -04:00
..
nyc_schools_progress_report_ec_2013.xlsx (core) move data engine code to core 2020-07-29 08:57:25 -04:00
strange_dates.xlsx (core) Run and test imports only in Python 3, upgrade openpyxl, fix weird date handling 2022-09-02 16:27:34 +02:00
test_boolean.xlsx Add BooleanConverter to map proper boolean cells to a Bool column 2022-09-10 07:07:45 +02:00
test_empty_rows.xlsx (core) Switch excel import parsing from messytables+xlrd to openpyxl, and ignore empty rows 2022-05-12 14:43:21 +02:00
test_encoding_utf8.csv (core) Improve encoding detection for csv imports, and make encoding an editable option. 2023-08-24 09:50:52 -04:00
test_excel_numeric_gs.xlsx (core) Fix issue that ints would be imported with a trailing ".0" from Google Sheets. 2023-02-26 15:24:15 -05:00
test_excel_types.csv (core) Move file import plugins into core/sandbox/grist 2021-08-09 18:37:14 +02:00
test_excel_types.xlsx (core) Move file import plugins into core/sandbox/grist 2021-08-09 18:37:14 +02:00
test_excel.xlsx (core) Move file import plugins into core/sandbox/grist 2021-08-09 18:37:14 +02:00
test_falsy_cells.xlsx Fix columns with falsy cells wrongly parsed as dates (#276) 2022-09-09 15:13:34 -04:00
test_headers_with_none_cell.xlsx Be more accepting with None value in headers candidate (#331) 2022-10-31 15:57:26 -04:00
test_import_csv.csv (core) Move file import plugins into core/sandbox/grist 2021-08-09 18:37:14 +02:00
test_invalid_dimensions.xlsx (core) Handle importing xls files with invalid dimensions 2022-06-16 08:39:17 -07:00
test_isdigit.csv (core) Fix import parsing from choking up on Python isdigit() surprises 2021-09-20 16:17:34 -04:00
test_long_cell.csv (core) Fix bug with "maximum recursion depth exceeded" in imports. 2021-08-20 17:44:48 -04:00
test_single_merged_cell.xlsx (core) Move file import plugins into core/sandbox/grist 2021-08-09 18:37:14 +02:00