gristlabs_grist-core/app/server
Paul Fitzpatrick e30d0fd5d0 (core) fix sync to s3 when doc is marked as dirty but proves to be clean
Summary:
This fixes a two problems:
 * A mistake in `KeyedMutex.runExclusive`.
 * Logic about saving a document to s3 when the document is found to match what is already there.

`HostedStorageManager.flushDoc` could get caught in a loop if a document was uploaded to s3 and then, without any change to it, marked as dirty.  Low level code would detect there was no change and skip the upload; but then the snapshotId could be unknown, causing an error and retries. This diff fixes that problem by discovering the snapshotId on downloads and tracking it. It also corrects a mutex problem that may have been creating the scenario. A small delay is added to `flushDoc` to mitigate the effect of similar problems in future. Exponential backoff would be good, but `flushDoc` is called in some situations where long delays would negatively impact worker shutdown or user work.

Test Plan: added tests

Reviewers: dsagal

Reviewed By: dsagal

Differential Revision: https://phab.getgrist.com/D2654
2020-11-10 08:12:31 -05:00
..
lib (core) fix sync to s3 when doc is marked as dirty but proves to be clean 2020-11-10 08:12:31 -05:00
declarations.d.ts (core) remove metrics 2020-09-29 18:57:56 -04:00
devServerMain.ts (core) remove metrics 2020-09-29 18:57:56 -04:00
mergedServerMain.ts (core) remove metrics 2020-09-29 18:57:56 -04:00
serverMethods.js (core) back-end support for tables that are accessible only by owners 2020-09-14 18:05:27 -04:00
tsconfig.json (core) move home server into core 2020-07-21 20:39:10 -04:00