gristlabs_grist-core/test/server
Dmitry S d5a4605d2a (core) Improve encoding detection for csv imports, and make encoding an editable option.
Summary:
- Using a sample of data was causing poor detection if the sample were
  cut mid-character. Switch to using line-based detection.
- Add a simple option for changing encoding. No convenient UI is offered
  since config UI is auto-generated, but this at least makes it possible to
  recover from bad guesses.
- Upgrades chardet library for good measure.

- Also fixes python3-building step, to more reliably rebuild Python
  dependencies when requirements3.* files change.

Test Plan:
Added a python-side test case, and a browser test that encodings can
be switched, errors are displayed, and wrong encodings fail recoverably.

Reviewers: alexmojaki

Reviewed By: alexmojaki

Differential Revision: https://phab.getgrist.com/D3979
2023-08-24 09:50:52 -04:00
..
lib (core) move ACLFormula test 2023-08-22 14:24:51 -04:00
utils (core) sanitizing redis errors 2023-06-06 10:51:17 +02:00
Comm.ts (core) Manage memory used for websocket responses to reduce the risk of server crashes. 2023-08-07 11:28:31 -04:00
customUtil.ts (core) Fix nbrowser/CopyPaste test on Mac 2022-07-29 14:08:29 +02:00
docTools.ts (core) Porting the AI evaluation script 2023-03-15 14:54:28 +01:00
generateInitialDocSql.ts update comment 2023-01-17 15:59:09 -05:00
gristClient.ts (core) control the distribution of attachment metadata 2022-12-22 09:10:30 -05:00
testUtils.ts (core) Improve encoding detection for csv imports, and make encoding an editable option. 2023-08-24 09:50:52 -04:00
wait.ts (core) Moving nbrowser tests to grist-core 2022-10-25 17:22:54 +02:00