7 Commits (1c6f80f956dcf5e1522caa1be518a151f850c041)

Author	SHA1	Message	Date
Alex Hall	a701b4bf13	(core) Remove expired attachments every hour and on shutdown ... Summary: Call ActiveDoc.removeUnusedAttachments every hour using setInterval, and in ActiveDoc.shutdown (which also clears said interval). Unrelated: small fix to my webhooks code which was creating a redis client on shutdown just to quit it. Test Plan: Tweaked DocApi test to remove expired attachments by force-reloading the doc, so that it removes them during shutdown. Extracted a new testing endpoint /verifyFiles to support this test (previously running that code only happened with `/removeUnused?verifyfiles=1`). Tested the setInterval part manually. Reviewers: paulfitz, dsagal Reviewed By: paulfitz Subscribers: dsagal Differential Revision: https://phab.getgrist.com/D3387	2 years ago
Alex Hall	d7514e9cfc	(core) Create _grist_Attachments_fileIdent index in new docs ... Summary: Patching up the mistake in https://phab.getgrist.com/D3374#inline-38023. Test Plan: this Reviewers: dsagal, paulfitz Reviewed By: dsagal, paulfitz Differential Revision: https://phab.getgrist.com/D3382	2 years ago
Paul Fitzpatrick	b2715ae9ef	(core) forbid use of sqlite ATTACH except during VACUUM ... Summary: This calls sqlite3_limit(SQLITE_LIMIT_ATTACHED, 0) so that if ever an `ATTACH` were snuck into an SQL query, it would be denied. The limit needs to be waived when calling VACUUM since the implementation of VACUUM uses ATTACH. Test Plan: added test; existing tests should pass Reviewers: alexmojaki Reviewed By: alexmojaki Subscribers: alexmojaki Differential Revision: https://phab.getgrist.com/D3316	3 years ago
Edward Betts	d6e0e1fee3	Correct spelling mistakes	3 years ago
George Gevoian	e1780e4f58	(core) Migrate import code from data engine to Node ... Summary: Finishing imports now occurs in Node instead of the data engine, which makes it possible to import into on-demand tables. Merging code was also refactored and now uses a SQL query to diff source and destination tables in order to determine what to update or add. Also fixes a bug where incremental imports involving Excel files with multiple sheets would fail due to the UI not serializing merge options correctly. Test Plan: Browser tests. Reviewers: jarek Reviewed By: jarek Differential Revision: https://phab.getgrist.com/D3046	3 years ago
Paul Fitzpatrick	71519d9e5c	(core) revamp snapshot inventory ... Summary: Deliberate changes: * save snapshots to s3 prior to migrations. * label migration snapshots in s3 metadata. * avoid pruning migration snapshots for a month. Opportunistic changes: * Associate document timezone with snapshots, so pruning can respect timezones. * Associate actionHash/Num with snapshots. * Record time of last change in snapshots (rather than just s3 upload time, which could be a while later). This ended up being a biggish change, because there was nowhere ideal to put tags (list of possibilities in diff). Test Plan: added tests Reviewers: dsagal Reviewed By: dsagal Differential Revision: https://phab.getgrist.com/D2646	4 years ago
Paul Fitzpatrick	5ef889addd	(core) move home server into core ... Summary: This moves enough server material into core to run a home server. The data engine is not yet incorporated (though in manual testing it works when ported). Test Plan: existing tests pass Reviewers: dsagal Reviewed By: dsagal Differential Revision: https://phab.getgrist.com/D2552	4 years ago