gristlabs_grist-core/app
Cyprien P 1ff93f89c2 (core) Porting the AI evaluation script
Summary:
Porting script that run an evaluation against our formula dataset.

To test you need an openai key (see here: https://platform.openai.com/)
or hugging face (it should work as well), then checkout the branch and run

`OPENAI_API_KEY=<my_openai_api_key> node core/test/formula-dataset/runCompletion.js`

Test Plan:
Needs manually testing: so far there is no plan to make it part of CI.

The current score is somewhere around 34 successful prompts over a total of 47.

Reviewers: paulfitz

Reviewed By: paulfitz

Subscribers: jarek

Differential Revision: https://phab.getgrist.com/D3816
2023-03-15 14:54:28 +01:00
..
client (core) Removing warnings about deprecated shortcuts. 2023-03-15 10:50:14 +01:00
common (core) Porting the AI evaluation script 2023-03-15 14:54:28 +01:00
gen-server (core) updates from grist-core 2023-02-21 10:49:19 -05:00
plugin Use relative imports only in plugin folder (#328) 2022-10-26 10:41:38 -04:00
server (core) Porting the AI evaluation script 2023-03-15 14:54:28 +01:00
tsconfig.json (core) move home server into core 2020-07-21 20:39:10 -04:00