Dmitry S d5a4605d2a (core) Improve encoding detection for csv imports, and make encoding an editable option. ... Summary: - Using a sample of data was causing poor detection if the sample were cut mid-character. Switch to using line-based detection. - Add a simple option for changing encoding. No convenient UI is offered since config UI is auto-generated, but this at least makes it possible to recover from bad guesses. - Upgrades chardet library for good measure. - Also fixes python3-building step, to more reliably rebuild Python dependencies when requirements3.* files change. Test Plan: Added a python-side test case, and a browser test that encodings can be switched, errors are displayed, and wrong encodings fail recoverably. Reviewers: alexmojaki Reviewed By: alexmojaki Differential Revision: https://phab.getgrist.com/D3979		2023-08-24 09:50:52 -04:00
..
nyc_schools_progress_report_ec_2013.xlsx	(core) move data engine code to core	2020-07-29 08:57:25 -04:00
strange_dates.xlsx	(core) Run and test imports only in Python 3, upgrade openpyxl, fix weird date handling	2022-09-02 16:27:34 +02:00
test_boolean.xlsx	Add BooleanConverter to map proper boolean cells to a Bool column	2022-09-10 07:07:45 +02:00
test_empty_rows.xlsx	(core) Switch excel import parsing from messytables+xlrd to openpyxl, and ignore empty rows	2022-05-12 14:43:21 +02:00
test_encoding_utf8.csv	(core) Improve encoding detection for csv imports, and make encoding an editable option.	2023-08-24 09:50:52 -04:00
test_excel_numeric_gs.xlsx	(core) Fix issue that ints would be imported with a trailing ".0" from Google Sheets.	2023-02-26 15:24:15 -05:00
test_excel_types.csv	(core) Move file import plugins into core/sandbox/grist	2021-08-09 18:37:14 +02:00
test_excel_types.xlsx	(core) Move file import plugins into core/sandbox/grist	2021-08-09 18:37:14 +02:00
test_excel.xlsx	(core) Move file import plugins into core/sandbox/grist	2021-08-09 18:37:14 +02:00
test_falsy_cells.xlsx	Fix columns with falsy cells wrongly parsed as dates (#276)	2022-09-09 15:13:34 -04:00
test_headers_with_none_cell.xlsx	Be more accepting with None value in headers candidate (#331)	2022-10-31 15:57:26 -04:00
test_import_csv.csv	(core) Move file import plugins into core/sandbox/grist	2021-08-09 18:37:14 +02:00
test_invalid_dimensions.xlsx	(core) Handle importing xls files with invalid dimensions	2022-06-16 08:39:17 -07:00
test_isdigit.csv	(core) Fix import parsing from choking up on Python isdigit() surprises	2021-09-20 16:17:34 -04:00
test_long_cell.csv	(core) Fix bug with "maximum recursion depth exceeded" in imports.	2021-08-20 17:44:48 -04:00
test_single_merged_cell.xlsx	(core) Move file import plugins into core/sandbox/grist	2021-08-09 18:37:14 +02:00