George Gevoian 94eec5e906 (core) Add AI Assistant retry with shorter prompt ...

Summary:
If the longer OpenAI model exceeds the OpenAPI context length, we now perform another retry with a
shorter variant of the formula prompt. The shorter prompt excludes non-referenced tables and lookup
method definitions, which should help reduce token usage in documents with larger schemas.

Test Plan: Server test.

Reviewers: JakubSerafin

Reviewed By: JakubSerafin

Subscribers: JakubSerafin

Differential Revision: https://phab.getgrist.com/D4184

2024-02-12 11:06:52 -05:00

..

AccessTokens.ts

(core) add an access token mechanism to help with attachments in custom widgets

2022-07-19 11:55:18 -04:00

ACLFormula.ts

(core) Decode cell values to prevent working around rule using 'in' on lists

2023-12-04 23:34:08 +02:00

ActionHistory.ts

(core) Fix issue with lodash's map interpreting objects with length as array-like

2023-07-01 21:07:39 -04:00

ActionHistoryImpl.ts

support other SQLite wrappers, and various hooks needed by grist-static (#516)

2023-05-23 15:17:28 -04:00

ActiveDoc.ts

(core) Add AI Assistant retry with shorter prompt

2024-02-12 11:06:52 -05:00

ActiveDocImport.ts

adapt to slight differences in linting (#842)

2024-02-05 09:42:57 -05:00

AppEndpoint.ts

(core) Fix bug forcing login on some form URLs

2024-02-01 12:10:52 -05:00

AppSettings.ts

add an endpoint for doing SQL selects (#641)

2023-09-04 09:21:18 -04:00

Assistance.ts

(core) Add AI Assistant retry with shorter prompt

2024-02-12 11:06:52 -05:00

Authorizer.ts

(core) Revamp ForwardAuthLogin and unify with GRIST_PROXY_AUTH_HEADER

2023-11-07 16:30:49 -05:00

BrowserSession.ts

Issue 740 OIDC login redirect (#742)

2023-11-15 09:23:32 -05:00

checksumFile.ts

(core) move home server into core

2020-07-21 20:39:10 -04:00

Client.ts

Fix server crash when client passes malformed JSON (#826)

2024-01-23 12:07:39 -05:00

Comm.ts

(core) Exit more cleanly on unhandled errors, and handle errors writing to Clients.

2023-12-01 09:42:00 -05:00

configureMinIOExternalStorage.ts

Abort when MinIO bucket does not have versioning enabled #545 (#546)

2023-07-10 06:24:55 -04:00

dbUtils.ts

Introduce TYPEORM_EXTRA env variable (#770)

2023-11-27 10:47:56 -05:00

DiscourseConnect.ts

(core) Adding GristConnect login system

2022-05-18 20:28:25 +02:00

DocApi.ts

(core) Improve API Console and link from Document Settings.

2024-01-29 10:08:19 -05:00

DocClients.ts

(core) Exit more cleanly on unhandled errors, and handle errors writing to Clients.

2023-12-01 09:42:00 -05:00

DocManager.ts

(core) add initial support for special shares

2024-01-04 05:57:38 -05:00

DocPluginData.ts

(core) move home server into core

2020-07-21 20:39:10 -04:00

DocPluginManager.ts

(core) add an access token mechanism to help with attachments in custom widgets

2022-07-19 11:55:18 -04:00

DocSession.ts

(core) notify home db of shares when copying/forking/uploading docs

2024-01-23 08:09:20 -05:00

DocSnapshots.ts

Track saved version per hour, day, week, month, year, and number of times a version with parameter (#509)

2023-05-12 11:38:29 -04:00

DocStorage.ts

add an endpoint for doing SQL selects (#641)

2023-09-04 09:21:18 -04:00

DocStorageManager.ts

(core) dust off electron build a little bit

2022-07-29 11:19:26 -04:00

docUtils.d.ts

(core) move home server into core

2020-07-21 20:39:10 -04:00

docUtils.js

Correct spelling mistakes

2022-02-19 09:46:49 +00:00

DocWorker.ts

(core) Form Publishing

2024-01-12 11:58:12 -08:00

DocWorkerMap.ts

(core) Add unquarantine command to admin CLI

2022-08-15 13:04:55 -07:00

DocWorkerUtils.ts

(core) Add support for auto-copying docs on signup

2023-09-06 15:12:08 -04:00

ExcelFormatter.ts

(core) Currency from grist column is persistent when exporting to excel

2023-05-08 10:39:01 +02:00

ExpandedQuery.ts

Correct spelling mistakes

2022-02-19 09:46:49 +00:00

Export.ts

Option to export colId as header in CSV / XSLX instead of label (#688) (#692)

2023-10-15 20:17:43 -04:00

ExportCSV.ts

Option to export colId as header in CSV / XSLX instead of label (#688) (#692)

2023-10-15 20:17:43 -04:00

ExportTableSchema.ts

Add header=colId option for the table-schema API #719 (#749)

2023-11-17 17:45:15 +02:00

ExportXLSX.ts

add hooks for tweaking how downloads happen (for grist-static) (#665)

2023-09-09 14:50:32 -04:00

expressWrap.ts

(core) Update dependencies

2023-10-11 17:36:58 -04:00

ExternalStorage.ts

(core) Faster builds all around.

2022-07-04 10:42:40 -04:00

extractOrg.ts

(core) support for bundling custom widgets with the Grist app

2023-10-27 17:00:10 -04:00

FileParserElement.ts

(core) move home server into core

2020-07-21 20:39:10 -04:00

filterUtils.ts

(core) uncheck FullCopy special when copying/forking a document

2021-04-29 08:56:54 -04:00

FlexServer.ts

(core) Fix bug forcing login on some form URLs

2024-02-01 12:10:52 -05:00

ForwardAuthLogin.ts

(core) Revamp ForwardAuthLogin and unify with GRIST_PROXY_AUTH_HEADER

2023-11-07 16:30:49 -05:00

GoogleAuth.ts

Add ws id and doc name params to POST /docs (#655)

2023-09-05 14:27:35 -04:00

GoogleExport.ts

Add ws id and doc name params to POST /docs (#655)

2023-09-05 14:27:35 -04:00

GoogleImport.ts

(core) Adding DELETE /api/docs/webhooks/queue endpoint to clear the queue

2022-12-01 12:23:19 +01:00

GranularAccess.ts

(core) add initial support for special shares

2024-01-04 05:57:38 -05:00

GristServer.ts

(core) For slowly reported telemetry, add breaks to give other processes a chance to run

2023-11-28 14:34:36 -05:00

gristSessions.ts

(core) Add options to /status health-check endpoints to check DB and Redis liveness.

2023-10-02 14:41:04 -04:00

gristSettings.ts

move getTemplateOrg method; enable template org in docker tests (#602)

2023-07-31 16:10:59 -04:00

guessExt.ts

(core) Switch excel import parsing from messytables+xlrd to openpyxl, and ignore empty rows

2022-05-12 14:43:21 +02:00

hashingUtils.ts

(core) Add Support Grist page and nudge

2023-07-04 17:36:59 -04:00

HashUtil.ts

(core) add more detail to /compare endpoint

2020-09-18 16:31:29 -04:00

HostedMetadataManager.ts

(core) Faster builds all around.

2022-07-04 10:42:40 -04:00

HostedStorageManager.ts

(core) Persist forks in home db

2023-02-20 22:46:36 -05:00

httpEncoding.ts

(core) External requests

2022-06-17 21:53:20 +02:00

IBilling.ts

(core) Add basic activation page to grist-ee

2022-08-23 10:30:52 -07:00

IChecksumStore.ts

(core) revamp snapshot inventory

2020-10-30 13:52:46 -04:00

ICreate.ts

(core) move apiserver tests to core, disentangling notifier+billing parts

2023-12-26 08:43:12 -05:00

IDocStorageManager.ts

(core) add a yarn run cli tool, and add a sqlite gristify option

2022-07-14 12:00:30 -04:00

idUtils.ts

(core) Persist forks in home db

2023-02-20 22:46:36 -05:00

IElectionStore.ts

(core) move some material to core that slipped through in a rebase

2020-07-23 11:29:05 -04:00

initialDocSql.ts

(core) add initial support for special shares

2024-01-04 05:57:38 -05:00

INotifier.ts

(core) move apiserver tests to core, disentangling notifier+billing parts

2023-12-26 08:43:12 -05:00

ISandbox.ts

(core) Faster builds all around.

2022-07-04 10:42:40 -04:00

IShell.ts

(core) dust off electron build a little bit

2022-07-29 11:19:26 -04:00

ITestingHooks-ti.ts

(core) Exit more cleanly on unhandled errors, and handle errors writing to Clients.

2023-12-01 09:42:00 -05:00

ITestingHooks.ts

(core) Exit more cleanly on unhandled errors, and handle errors writing to Clients.

2023-12-01 09:42:00 -05:00

log.ts

fix log.add under electron (#478)

2023-04-03 13:29:35 -04:00

LogMethods.ts

(core) Faster builds all around.

2022-07-04 10:42:40 -04:00

manifest.ts

(core) support for bundling custom widgets with the Grist app

2023-10-27 17:00:10 -04:00

MemoryPool.ts

(core) Manage memory used for websocket responses to reduce the risk of server crashes.

2023-08-07 11:28:31 -04:00

MinimalLogin.ts

A set of tweaks to simplify electron packaging (#421)

2023-02-13 15:52:17 -05:00

MinIOExternalStorage.ts

Issue 359 support scaleway (#577)

2023-07-20 06:16:58 -04:00

NSandbox.ts

(core) change ActiveDoc load and Sandbox call log messages to be aggregation-friendly

2024-01-24 14:06:38 -05:00

NullSandbox.ts

(core) Fix snapshot migrations

2023-05-23 15:50:15 -04:00

OIDCConfig.ts

OIDC: Support overriding end_session_endpoint using environment variable GRIST_OIDC_IDP_END_SESSION_ENDPOINT (#802)

2024-01-03 15:49:32 -05:00

OnDemandActions.ts

(core) Adds a UI panel for managing webhooks

2023-05-08 18:25:27 -04:00

PermissionInfo.ts

(core) Fixing memos in record dependent rules.

2023-09-08 10:16:09 +02:00

Permit.ts

(core) Add new Grist login page

2022-04-01 15:24:19 -07:00

places.ts

A set of tweaks to simplify electron packaging (#421)

2023-02-13 15:52:17 -05:00

PluginEndpoint.ts

include the @gristlabs/grist-widget package, so Calendar is always available (#745)

2023-11-28 09:28:15 -05:00

PluginManager.ts

include the @gristlabs/grist-widget package, so Calendar is always available (#745)

2023-11-28 09:28:15 -05:00

ProcessMonitor.ts

(core) Add new telemetry events

2023-11-01 10:49:33 -04:00

ProxyAgent.ts

(core) Add logging of errors whenever ProxyAgent is used, and a test for it.

2023-05-17 10:21:53 -04:00

reportTimeTaken.ts

(core) Faster builds all around.

2022-07-04 10:42:40 -04:00

Requests.ts

REQUEST now supports POST (#588)

2023-07-30 15:13:43 -04:00

requestUtils.ts

(core) Add welcomeQuestionsSubmitted telemetry event

2023-09-13 00:31:04 -04:00

RowAccess.ts

(core) control the distribution of attachment metadata

2022-12-22 09:10:30 -05:00

SafePythonComponent.ts

(core) Run and test imports only in Python 3, upgrade openpyxl, fix weird date handling

2022-09-02 16:27:34 +02:00

SamlConfig.ts

(core) Fix delete user button for Google-only accounts

2023-10-18 10:52:58 -04:00

SandboxControl.ts

(core) Update dependencies

2023-10-11 17:36:58 -04:00

sandboxUtil.ts

(core) Update logging in sandbox code, and log tracebacks as single log messages.

2023-07-18 11:21:25 -04:00

sendAppPage.ts

(core) updates from grist-core

2024-02-12 08:15:38 -05:00

ServerColumnGetters.ts

(core) Filter rows based on linked widgets when exporting view

2023-07-26 21:49:52 +02:00

ServerLocale.ts

(core) Converting server-side Comm.js to typescript

2022-06-07 15:47:17 -04:00

serverUtils.ts

(core) Add timeouts to prevent ActiveDoc bad state during shutdown.

2023-09-26 15:32:49 -04:00

Sessions.ts

(core) Converting server-side Comm.js to typescript

2022-06-07 15:47:17 -04:00

Sharing.ts

(core) updates from grist-core

2024-01-08 09:19:50 -05:00

shortDesc.ts

(core) move home server into core

2020-07-21 20:39:10 -04:00

shutdown.js

support other SQLite wrappers, and various hooks needed by grist-static (#516)

2023-05-23 15:17:28 -04:00

SqliteCommon.ts

add an endpoint for doing SQL selects (#641)

2023-09-04 09:21:18 -04:00

SQLiteDB.ts

add an endpoint for doing SQL selects (#641)

2023-09-04 09:21:18 -04:00

SqliteNode.ts

add an endpoint for doing SQL selects (#641)

2023-09-04 09:21:18 -04:00

TableMetadataLoader.ts

(core) Improve API Console and link from Document Settings.

2024-01-29 10:08:19 -05:00

TagChecker.ts

(core) move home server into core

2020-07-21 20:39:10 -04:00

Telemetry.ts

(core) Add visitorId to telemetry

2023-12-11 11:16:23 -05:00

TestingHooks.ts

(core) Exit more cleanly on unhandled errors, and handle errors writing to Clients.

2023-12-01 09:42:00 -05:00

TestLogin.ts

(core) make the support account configurable, and allow listing public sites

2022-10-14 14:23:59 -04:00

Throttle.ts

(core) Fix bugs with intervals

2022-08-25 12:38:36 -07:00

TimeQuery.ts

(core) Adds a UI panel for managing webhooks

2023-05-08 18:25:27 -04:00

Triggers.ts

Completely ignored disabled webhooks (#800)

2024-01-03 20:06:38 +02:00

UnsafeNodeComponent.ts

(core) Faster builds all around.

2022-07-04 10:42:40 -04:00

uploads.ts

(core) Add support for auto-copying docs on signup

2023-09-06 15:12:08 -04:00

WidgetRepository.ts

Change how a builtin custom widget bundle is found (#783)

2023-12-05 11:51:22 -05:00

WorkCoordinator.ts

support other SQLite wrappers, and various hooks needed by grist-static (#516)

2023-05-23 15:17:28 -04:00

workerExporter.ts

Option to export colId as header in CSV / XSLX instead of label (#688) (#692)

2023-10-15 20:17:43 -04:00