gristlabs_grist-core/sandbox
George Gevoian 94eec5e906 (core) Add AI Assistant retry with shorter prompt
Summary:
If the longer OpenAI model exceeds the OpenAPI context length, we now perform another retry with a
shorter variant of the formula prompt. The shorter prompt excludes non-referenced tables and lookup
method definitions, which should help reduce token usage in documents with larger schemas.

Test Plan: Server test.

Reviewers: JakubSerafin

Reviewed By: JakubSerafin

Subscribers: JakubSerafin

Differential Revision: https://phab.getgrist.com/D4184
2024-02-12 11:06:52 -05:00
..
docker
grist (core) Add AI Assistant retry with shorter prompt 2024-02-12 11:06:52 -05:00
gvisor
pyodide
bundle_as_wheel.sh
gen_js_schema.py
install_tz.js
MANIFEST.in
requirements3.in
requirements3.txt
requirements.txt
run.sh
setup.py
watch.sh