papers-we-love_papers-we-love/datastores

Datastores

• Calvin: Fast Distributed Transactions for Partitioned Database Systems

• f4: Facebook’s Warm BLOB Storage System

• The Case for Determinism in Database Systems

• Consistency Tradeoffs in Modern Distributed Database System Design

• Modularity and Scalability in Calvin

• Lightweight Locking for Main Memory Database Systems

• Cassandra - A Decentralized Structured Storage System

• CRUSH: Controlled, Scalable, Decentralized Placement of Replicated Data

• Don’t Settle for Eventual: Scalable Causal Consistency for Wide-Area Storage with COPS

• Dremel: Interactive Analysis of Web-Scale Datasets

• F1: A Distributed SQL Database That Scales

• HaLoop: Efficient Iterative Data Processing on Large Clusters

• HyperDex: A Distributed, Searchable Key-Value Store

• Introduction to a System for Distributed Databases SDD-1

• Making Reliable Distributed Systems in the Presence of Software Errors

• Managing Update Conflicts in Bayou, a Weakly Connected Replicated Storage System

• Map-Reduce-Merge: Simplified Relational Data Processing on Large Clusters

• MDCC: Multi-Data Center Consistency

• Optimistic replication

• The Dangers of Replication and a Solution

• Towards a Next Generation Data Center Architecture: Scalability and Commoditization

• GenDB: The Next Generation of Query Processing -- Synthesized, Not Engineered (2026) by Jiale Lao and Immanuel Trummer

  GenDB uses an LLM-powered agent to synthesize query execution code tailored to particular data, workloads, and hardware, making the case for query processing that is generated rather than maintained as a general-purpose engine.

• Bespoke OLAP: Synthesizing Workload-Specific One-size-fits-one Database Engines (2026) by Johannes Wehrstein, Timo Eckmann, Matthias Jasny, and Carsten Binnig

  This paper presents an autonomous pipeline that synthesizes a database engine for a fixed OLAP workload, using iterative performance evaluation and validation to turn LLM code generation into a high-performance system-building process.

Hosted Papers

• 📜 A Solution to the Network Challenges of Data Recovery in Erasure-coded Distributed Storage Systems: A Study on the Facebook Warehouse Cluster

• 📜 Bigtable: A Distributed Storage System for Structured Data

• 📜 Database Metatheory: Asking Big Queries

• 📜 Dynamo: Amazon’s Highly Available Key-value Store

• 📜 Elle: Inferring Isolation Anomalies from Experimental Observations

• 📜 Flat Datacenter Storage

• 📜 Freenet: A Distributed Anonymous Information Storage and Retrieval System

• 📜 The Google File System

• 📜 Megastore: Providing Scalable, Highly Available Storage for Interactive Services

• 📜 RADOS: A Scalable, Reliable Storage Service for Petabyte-scale Storage Clusters

• 📜 Spanner: Google’s Globally-Distributed Database

• 📜 Spartan: A distributed array framework with smart tiling

• 📜 Stasis: Flexible Transactional Storage

• 📜 TAO: Facebooks Distributed Data Store for the Social Graph'

• 📜 Transactional storage for geo-replicated systems

• 📜 Warp: Multi-Key Transactions for Key-Value Stores