Archives/gristlabs_grist-core
1
0
Fork 0
mirror of https://github.com/gristlabs/grist-core.git synced 2024-10-27 20:44:07 +00:00
Code Issues Projects Releases Wiki Activity
7a12a8ef28
gristlabs_grist-core/test/formula-dataset
History
Cyprien P 1ff93f89c2 (core) Porting the AI evaluation script 
Summary:
Porting script that run an evaluation against our formula dataset.

To test you need an openai key (see here: https://platform.openai.com/)
or hugging face (it should work as well), then checkout the branch and run

`OPENAI_API_KEY=<my_openai_api_key> node core/test/formula-dataset/runCompletion.js`

Test Plan:
Needs manually testing: so far there is no plan to make it part of CI.

The current score is somewhere around 34 successful prompts over a total of 47.

Reviewers: paulfitz

Reviewed By: paulfitz

Subscribers: jarek

Differential Revision: https://phab.getgrist.com/D3816
2023-03-15 14:54:28 +01:00
..
data (core) Porting the AI evaluation script 2023-03-15 14:54:28 +01:00
.gitignore (core) Porting the AI evaluation script 2023-03-15 14:54:28 +01:00
runCompletion_impl.ts (core) Porting the AI evaluation script 2023-03-15 14:54:28 +01:00
runCompletion.js (core) Porting the AI evaluation script 2023-03-15 14:54:28 +01:00