mirror of
https://github.com/gristlabs/grist-core.git
synced 2024-09-30 11:20:47 +00:00
1ff93f89c2
Summary: Porting script that run an evaluation against our formula dataset. To test you need an openai key (see here: https://platform.openai.com/) or hugging face (it should work as well), then checkout the branch and run `OPENAI_API_KEY=<my_openai_api_key> node core/test/formula-dataset/runCompletion.js` Test Plan: Needs manually testing: so far there is no plan to make it part of CI. The current score is somewhere around 34 successful prompts over a total of 47. Reviewers: paulfitz Reviewed By: paulfitz Subscribers: jarek Differential Revision: https://phab.getgrist.com/D3816
13 lines
496 B
JavaScript
13 lines
496 B
JavaScript
#!/usr/bin/env node
|
|
"use strict";
|
|
const path = require('path');
|
|
const codeRoot = path.dirname(path.dirname(path.dirname(__dirname)));
|
|
|
|
process.env.DATA_PATH = path.join(__dirname, 'data');
|
|
|
|
|
|
require('app-module-path').addPath(path.join(codeRoot, '_build'));
|
|
require('app-module-path').addPath(path.join(codeRoot, '_build', 'core'));
|
|
require('app-module-path').addPath(path.join(codeRoot, '_build', 'ext'));
|
|
require('test/formula-dataset/runCompletion_impl').runCompletion().catch(console.error);
|