gristlabs_grist-core/test/server
Cyprien P 1ff93f89c2 (core) Porting the AI evaluation script
Summary:
Porting script that run an evaluation against our formula dataset.

To test you need an openai key (see here: https://platform.openai.com/)
or hugging face (it should work as well), then checkout the branch and run

`OPENAI_API_KEY=<my_openai_api_key> node core/test/formula-dataset/runCompletion.js`

Test Plan:
Needs manually testing: so far there is no plan to make it part of CI.

The current score is somewhere around 34 successful prompts over a total of 47.

Reviewers: paulfitz

Reviewed By: paulfitz

Subscribers: jarek

Differential Revision: https://phab.getgrist.com/D3816
2023-03-15 14:54:28 +01:00
..
lib Merge pull request #406 from incubateur-territoires/column-description 2023-02-23 17:16:17 +01:00
Comm.ts (core) Faster builds all around. 2022-07-04 10:42:40 -04:00
customUtil.ts (core) Fix nbrowser/CopyPaste test on Mac 2022-07-29 14:08:29 +02:00
docTools.ts (core) Porting the AI evaluation script 2023-03-15 14:54:28 +01:00
generateInitialDocSql.ts update comment 2023-01-17 15:59:09 -05:00
gristClient.ts (core) control the distribution of attachment metadata 2022-12-22 09:10:30 -05:00
testUtils.ts (core) Faster builds all around. 2022-07-04 10:42:40 -04:00
wait.ts (core) Moving nbrowser tests to grist-core 2022-10-25 17:22:54 +02:00