gristlabs_grist-core/test
Cyprien P 1ff93f89c2 (core) Porting the AI evaluation script
Summary:
Porting script that run an evaluation against our formula dataset.

To test you need an openai key (see here: https://platform.openai.com/)
or hugging face (it should work as well), then checkout the branch and run

`OPENAI_API_KEY=<my_openai_api_key> node core/test/formula-dataset/runCompletion.js`

Test Plan:
Needs manually testing: so far there is no plan to make it part of CI.

The current score is somewhere around 34 successful prompts over a total of 47.

Reviewers: paulfitz

Reviewed By: paulfitz

Subscribers: jarek

Differential Revision: https://phab.getgrist.com/D3816
2023-03-15 14:54:28 +01:00
..
client (core) Minimazing widgets 2023-03-02 11:22:49 +01:00
common (core) Fix the empty values last option in multicol sorting 2023-01-31 12:14:22 +01:00
deployment Adding new lines at the end 2022-09-30 17:00:38 +02:00
fixtures (core) Fix test util and upgrade fixtures 2023-03-01 10:39:09 -05:00
formula-dataset (core) Porting the AI evaluation script 2023-03-15 14:54:28 +01:00
gen-server (core) Persist forks in home db 2023-02-20 22:46:36 -05:00
nbrowser (core) Add overflowTooltip() tool, and use for long tables in widget picker, and long page names. 2023-03-13 21:47:35 -04:00
server (core) Porting the AI evaluation script 2023-03-15 14:54:28 +01:00
timings run grist-core test batches in parallel (#444) 2023-03-03 09:53:33 -05:00
.eslintrc.js Fixing all eslint's reported error 2023-01-03 17:22:58 +01:00
chai-as-promised.js (core) Faster builds all around. 2022-07-04 10:42:40 -04:00
init-mocha-webdriver.js Correct spelling mistakes 2022-02-19 09:46:49 +00:00
mocha.opts run grist-core test batches in parallel (#444) 2023-03-03 09:53:33 -05:00
report-why-tests-hang.js (core) Move report-why-tests-hang helper to core 2021-04-26 23:52:16 -04:00
setupPaths.js add test/upgradeDocument utility 2023-01-17 16:14:15 -05:00
split-tests.js run grist-core test batches in parallel (#444) 2023-03-03 09:53:33 -05:00
test_under_docker.sh Adding dedicated folder for external tests 2022-09-30 16:45:35 +02:00
testUtils.ts (core) add missing tsconfig file that affects IDEs 2022-05-27 13:48:58 -04:00
tsconfig.json (core) Faster builds all around. 2022-07-04 10:42:40 -04:00
upgradeDocument add test/upgradeDocument utility 2023-01-17 16:14:15 -05:00
upgradeDocumentImpl.ts add test/upgradeDocument utility 2023-01-17 16:14:15 -05:00
utils.js (core) Moving client and common tests to core 2022-08-23 19:20:10 +02:00
xunit-file.js (core) Parallelize jenkins by running on multiple machines. 2022-07-01 16:18:36 -04:00