From 515d80eede91e8244a12529104dba69c42ba2318 Mon Sep 17 00:00:00 2001 From: Zachary Jones Date: Fri, 9 Oct 2015 01:28:48 -0400 Subject: [PATCH] reorganized Datastore-relaed papers in the Distributed Systems group moved datastore papers from the distributed_systems folder, into datastores updated the READMEs, including with out-of-folder links --- datastores/README.md | 27 ++++++++- ...ted-storage-system-for-structured-data.pdf | Bin ...ase-metatheory--asking-the-big-queries.pdf | Bin ...azons-highly-available-key-value-store.pdf | Bin .../flat-datacenter-storage.pdf | Bin ...ymous-information-and-retrieval-system.pdf | Bin ...lable-storage-for-interactive-services.pdf | Bin ...sure-coded-distributed-storage-systems.pdf | Bin ...ce-for-petabyte-scale-storage-clusters.pdf | Bin ...google's-globally-distributed-database.pdf | Bin ...nal-storage-for-geo-replicated-systems.pdf | Bin ...-key-transactions-for-key-value-stores.pdf | Bin distributed_systems/README.md | 57 ++++++++++-------- 13 files changed, 58 insertions(+), 26 deletions(-) rename {distributed_systems => datastores}/bigtable-a-distributed-storage-system-for-structured-data.pdf (100%) rename {distributed_systems => datastores}/database-metatheory--asking-the-big-queries.pdf (100%) rename {distributed_systems => datastores}/dynamo-amazons-highly-available-key-value-store.pdf (100%) rename {distributed_systems => datastores}/flat-datacenter-storage.pdf (100%) rename {distributed_systems => datastores}/freenet-a-distributed-anonymous-information-and-retrieval-system.pdf (100%) rename {distributed_systems => datastores}/megastore-providing-scalable-highly-available-storage-for-interactive-services.pdf (100%) rename {distributed_systems => datastores}/network-challenges-of-data-recovery-in-erasure-coded-distributed-storage-systems.pdf (100%) rename {distributed_systems => datastores}/rados-a-scalable-reliable-storage-service-for-petabyte-scale-storage-clusters.pdf (100%) rename {distributed_systems => datastores}/spanner-google's-globally-distributed-database.pdf (100%) rename {distributed_systems => datastores}/transactional-storage-for-geo-replicated-systems.pdf (100%) rename {distributed_systems => datastores}/warp-multi-key-transactions-for-key-value-stores.pdf (100%) diff --git a/datastores/README.md b/datastores/README.md index 2293502..7df5261 100644 --- a/datastores/README.md +++ b/datastores/README.md @@ -5,4 +5,29 @@ ## Hosted Papers -* :scroll: [Stasis: Flexible Transactional Storage](stasis-flexible-transactional-storage.pdf) * :scroll: [TAO: Facebooks Distributed Data Store for the Social Graph'](tao-facebook-distributed-datastore.pdf) \ No newline at end of file +* :scroll: [Bigtable: A Distributed Storage System for Structured Data](bigtable-a-distributed-storage-system-for-structured-data.pdf) + +* :scroll: [Database Metatheory: Asking Big Queries](database-metatheory--asking-the-big-queries.pdf) + +* :scroll: [Dynamo: Amazon’s Highly Available Key-value Store](dynamo-amazons-highly-available-key-value-store.pdf) + +* :scroll: [Flat Datacenter Storage](flat-datacenter-storage.pdf) + +* :scroll: [Freenet: A Distributed Anonymous Information Storage and Retrieval System](freenet-a-distributed-anonymous-information-and-retrieval-system.pdf) + +* :scroll: [Megastore: Providing Scalable, Highly Available Storage for Interactive Services](megastore-providing-scalable-highly-available-storage-for-interactive-services.pdf) + +* :scroll: [A Solution to the Network Challenges of Data Recovery in Erasure-coded Distributed Storage Systems: A Study on the Facebook Warehouse Cluster](network-challenges-of-data-recovery-in-erasure-coded-distributed-storage-systems.pdf) + +* :scroll: [RADOS: A Scalable, Reliable Storage Service for Petabyte-scale Storage Clusters](rados-a-scalable-reliable-storage-service-for-petabyte-scale-storage-clusters.pdf) + +* :scroll: [Spanner: Google’s Globally-Distributed Database](spanner-google's-globally-distributed-database.pdf) + +* :scroll: [Stasis: Flexible Transactional Storage](stasis-flexible-transactional-storage.pdf) + +* :scroll: [TAO: Facebooks Distributed Data Store for the Social Graph'](tao-facebook-distributed-datastore.pdf) + +* :scroll: [Transactional storage for geo-replicated systems](transactional-storage-for-geo-replicated-systems.pdf) + +* :scroll: [Warp: Multi-Key Transactions for Key-Value Stores](warp-multi-key-transactions-for-key-value-stores.pdf) + diff --git a/distributed_systems/bigtable-a-distributed-storage-system-for-structured-data.pdf b/datastores/bigtable-a-distributed-storage-system-for-structured-data.pdf similarity index 100% rename from distributed_systems/bigtable-a-distributed-storage-system-for-structured-data.pdf rename to datastores/bigtable-a-distributed-storage-system-for-structured-data.pdf diff --git a/distributed_systems/database-metatheory--asking-the-big-queries.pdf b/datastores/database-metatheory--asking-the-big-queries.pdf similarity index 100% rename from distributed_systems/database-metatheory--asking-the-big-queries.pdf rename to datastores/database-metatheory--asking-the-big-queries.pdf diff --git a/distributed_systems/dynamo-amazons-highly-available-key-value-store.pdf b/datastores/dynamo-amazons-highly-available-key-value-store.pdf similarity index 100% rename from distributed_systems/dynamo-amazons-highly-available-key-value-store.pdf rename to datastores/dynamo-amazons-highly-available-key-value-store.pdf diff --git a/distributed_systems/flat-datacenter-storage.pdf b/datastores/flat-datacenter-storage.pdf similarity index 100% rename from distributed_systems/flat-datacenter-storage.pdf rename to datastores/flat-datacenter-storage.pdf diff --git a/distributed_systems/freenet-a-distributed-anonymous-information-and-retrieval-system.pdf b/datastores/freenet-a-distributed-anonymous-information-and-retrieval-system.pdf similarity index 100% rename from distributed_systems/freenet-a-distributed-anonymous-information-and-retrieval-system.pdf rename to datastores/freenet-a-distributed-anonymous-information-and-retrieval-system.pdf diff --git a/distributed_systems/megastore-providing-scalable-highly-available-storage-for-interactive-services.pdf b/datastores/megastore-providing-scalable-highly-available-storage-for-interactive-services.pdf similarity index 100% rename from distributed_systems/megastore-providing-scalable-highly-available-storage-for-interactive-services.pdf rename to datastores/megastore-providing-scalable-highly-available-storage-for-interactive-services.pdf diff --git a/distributed_systems/network-challenges-of-data-recovery-in-erasure-coded-distributed-storage-systems.pdf b/datastores/network-challenges-of-data-recovery-in-erasure-coded-distributed-storage-systems.pdf similarity index 100% rename from distributed_systems/network-challenges-of-data-recovery-in-erasure-coded-distributed-storage-systems.pdf rename to datastores/network-challenges-of-data-recovery-in-erasure-coded-distributed-storage-systems.pdf diff --git a/distributed_systems/rados-a-scalable-reliable-storage-service-for-petabyte-scale-storage-clusters.pdf b/datastores/rados-a-scalable-reliable-storage-service-for-petabyte-scale-storage-clusters.pdf similarity index 100% rename from distributed_systems/rados-a-scalable-reliable-storage-service-for-petabyte-scale-storage-clusters.pdf rename to datastores/rados-a-scalable-reliable-storage-service-for-petabyte-scale-storage-clusters.pdf diff --git a/distributed_systems/spanner-google's-globally-distributed-database.pdf b/datastores/spanner-google's-globally-distributed-database.pdf similarity index 100% rename from distributed_systems/spanner-google's-globally-distributed-database.pdf rename to datastores/spanner-google's-globally-distributed-database.pdf diff --git a/distributed_systems/transactional-storage-for-geo-replicated-systems.pdf b/datastores/transactional-storage-for-geo-replicated-systems.pdf similarity index 100% rename from distributed_systems/transactional-storage-for-geo-replicated-systems.pdf rename to datastores/transactional-storage-for-geo-replicated-systems.pdf diff --git a/distributed_systems/warp-multi-key-transactions-for-key-value-stores.pdf b/datastores/warp-multi-key-transactions-for-key-value-stores.pdf similarity index 100% rename from distributed_systems/warp-multi-key-transactions-for-key-value-stores.pdf rename to datastores/warp-multi-key-transactions-for-key-value-stores.pdf diff --git a/distributed_systems/README.md b/distributed_systems/README.md index d42dc33..b143390 100644 --- a/distributed_systems/README.md +++ b/distributed_systems/README.md @@ -104,12 +104,40 @@ * [VL2: A Scalable and Flexible Data Center Network](http://research.microsoft.com/pubs/80693/vl2-sigcomm09-final.pdf) +## Topics -## Related Works +### Datastores -### [“On the Electrodynamics of Moving Bodies” (1905) — Einstein](../historical/physics/on-the-electrodynamics-of-moving-bodies.pdf) +* :scroll: [Bigtable: A Distributed Storage System for Structured Data](../datastores/bigtable-a-distributed-storage-system-for-structured-data.pdf) -By solving the [asymmetries](http://en.wikipedia.org/wiki/Moving_magnet_and_conductor_problem) that arise in Maxwell’s equations, Einstein’s 1905 paper set the stage for current distributed systems work by demonstrating that there is no absolute frame of reference and by providing an upper bound on the speed of communication. +* :scroll: [Database Metatheory: Asking Big Queries](../datastores/database-metatheory--asking-the-big-queries.pdf) + +* :scroll: [Dynamo: Amazon’s Highly Available Key-value Store](../datastores/dynamo-amazons-highly-available-key-value-store.pdf) + +* :scroll: [Flat Datacenter Storage](../datastores/flat-datacenter-storage.pdf) + +* :scroll: [Freenet: A Distributed Anonymous Information Storage and Retrieval System](../datastores/freenet-a-distributed-anonymous-information-and-retrieval-system.pdf) + +* :scroll: [Megastore: Providing Scalable, Highly Available Storage for Interactive Services](../datastores/megastore-providing-scalable-highly-available-storage-for-interactive-services.pdf) + +* :scroll: [A Solution to the Network Challenges of Data Recovery in Erasure-coded Distributed Storage Systems: A Study on the Facebook Warehouse Cluster](../datastores/network-challenges-of-data-recovery-in-erasure-coded-distributed-storage-systems.pdf) + +* :scroll: [RADOS: A Scalable, Reliable Storage Service for Petabyte-scale Storage Clusters](../datastores/rados-a-scalable-reliable-storage-service-for-petabyte-scale-storage-clusters.pdf) + +* :scroll: [Spanner: Google’s Globally-Distributed Database](../datastores/spanner-google's-globally-distributed-database.pdf) + +* :scroll: [TAO: Facebooks Distributed Data Store for the Social Graph'](../datastores/tao-facebook-distributed-datastore.pdf) + +* :scroll: [Transactional storage for geo-replicated systems](../datastores/transactional-storage-for-geo-replicated-systems.pdf) + +* :scroll: [Warp: Multi-Key Transactions for Key-Value Stores](../datastores/warp-multi-key-transactions-for-key-value-stores.pdf) + + +## Physics + +* :scroll: [“On the Electrodynamics of Moving Bodies” (1905) — Einstein](../physics/on-the-electrodynamics-of-moving-bodies.pdf) + + By solving the [asymmetries](http://en.wikipedia.org/wiki/Moving_magnet_and_conductor_problem) that arise in Maxwell’s equations, Einstein’s 1905 paper set the stage for current distributed systems work by demonstrating that there is no absolute frame of reference and by providing an upper bound on the speed of communication. ## Other Hosted Papers @@ -126,8 +154,6 @@ By solving the [asymmetries](http://en.wikipedia.org/wiki/Moving_magnet_and_cond * :scroll: [Beehive: O(1) Lookup Performance for Power-Law Query Distributions in Peer-to-Peer Overlays](beehive-lookup-performance-for-power-law-query-distributions-in-peer-to-peer-overlays.pdf) -* :scroll: [Bigtable: A Distributed Storage System for Structured Data](bigtable-a-distributed-storage-system-for-structured-data.pdf) - * :scroll: [Byzantine Chain Replication](bizantine-chain-replication.pdf) * :scroll: [A Byzantine Fault Tolerant Distributed Commit Protocol](bizantine-fault-tolerant-distributed-commit-protocol.pdf) @@ -149,22 +175,14 @@ Distributed Caching Protocols for Relieving Hot Spots on the World Wide Web](con * :scroll: [Dapper, a Large-Scale Distributed Systems Tracing Infrastructure](dapper-a-large-scale-distributed-tracing-infrastructure.pdf) -* :scroll: [Database Metatheory: Asking Big Queries](database-metatheory--asking-the-big-queries.pdf) - * :scroll: [Distributed Snapshots: Determining Global States of Distributed Systems](distributed-snapshots-determining-global-states-of-distributed-systems.pdf) -* :scroll: [Dynamo: Amazon’s Highly Available Key-value Store](dynamo-amazons-highly-available-key-value-store.pdf) - * :scroll: [Eluding Carnivores: File Sharing with Strong Anonymity](eluding-carnivores-file-sharing-with-strong-anonymity.pdf) * :scroll: [End-to-end arguments in system design](end-to-end-arguments-in-system-design.pdf) * :scroll: [Epidemic Algorithms for Replicated Database Maintenance](epidemic-algorithms-for-replicated-database-maintenance.pdf) -* :scroll: [Flat Datacenter Storage](flat-datacenter-storage.pdf) - -* :scroll: [Freenet: A Distributed Anonymous Information Storage and Retrieval System](freenet-a-distributed-anonymous-information-and-retrieval-system.pdf) - * :scroll: [Harvest, Yield, and Scalable Tolerant Systems](harvest-yield-and-scalable-tolerant-systems.pdf) * :scroll: [Herbivore: A Scalable and Efficient Protocol for Anonymous Communication](herbivore-a-scalable-and-efficient-protocol-for-anonymous.pdf) @@ -187,12 +205,8 @@ Distributed Caching Protocols for Relieving Hot Spots on the World Wide Web](con * :scroll: [MapReduce: Simplified Data Processing on Large Clusters](mapreduce-simplified-data-processing-on-large-clusters.pdf) -* :scroll: [Megastore: Providing Scalable, Highly Available Storage for Interactive Services](megastore-providing-scalable-highly-available-storage-for-interactive-services.pdf) - * :scroll: [Mesos: A Platform for Fine-Grained Resource Sharing in the Data Center](mesos-a-platform-for-fine-grained-resource-sharing-in-the-data-center.pdf) -* :scroll: [A Solution to the Network Challenges of Data Recovery in Erasure-coded Distributed Storage Systems: A Study on the Facebook Warehouse Cluster](network-challenges-of-data-recovery-in-erasure-coded-distributed-storage-systems.pdf) - * :scroll: [Oblivious routing of highly variable traffic in service overlays and IP backbones](oblivious-routing-of-highly-variable-traffic-in-service-overlays-and-ip-backbones.pdf) * :scroll: [On proof and progress in mathematics](on-proof-and-progress-in-mathematics.pdf) @@ -205,8 +219,6 @@ Distributed Caching Protocols for Relieving Hot Spots on the World Wide Web](con * :scroll: [Paxos Made Simple](paxos-made-simple.pdf) -* :scroll: [RADOS: A Scalable, Reliable Storage Service for Petabyte-scale Storage Clusters](rados-a-scalable-reliable-storage-service-for-petabyte-scale-storage-clusters.pdf) - * :scroll: [Self-stabilizing Systems in Spite of Distributed Control](self-stabilizing-systems-in-spite-of-distributed-control.pdf) * :scroll: [SIFT: Design and Analysis of a Fault-Tolerant Computer for Aircraft Control](sift-design-and-analysis-of-a-fault-tolerant-computer-for-aircraft-contro.pdf) @@ -216,8 +228,6 @@ Distributed Caching Protocols for Relieving Hot Spots on the World Wide Web](con * :scroll: [Slution of a Problem in Concurrent Programming Control](solution-of-a-problem-in-concurrent-programming-control.pdf) -* :scroll: [Spanner: Google’s Globally-Distributed Database](spanner-google's-globally-distributed-database.pdf) - * :scroll: [Sparse Partitions](sparse-partitions.pdf) * :scroll: [Stronger Semantics for Low-Latency Geo-Replicated Storage](stronger-semantics-for-low-latency-geo-replicated-storage.pdf) @@ -231,16 +241,13 @@ Unconditional Sender and Recipient Untraceability](the-dining-cryptographers-pro * :scroll: [Towards a cloud computing research agenda](towards-a-cloud-computing-research-agenda.pdf) -* :scroll: [Transactional storage for geo-replicated systems](transactional-storage-for-geo-replicated-systems.pdf) - * :scroll: [Understanding the Limitations of Causally and Totally Ordered Communication](understanding-the-limitations-of-causally-and-totally-ordered-communication.pdf) * :scroll: [Viewing Control Structures as Patterns of Passing Messages](viewing-control-structures-as-patterns-of-passing-messages.pdf) * :scroll: [Warp: Multi-Key Transactions for Key-Value Stores](warp-multi-key-transactions-for-key-value-stores.pdf) -* :scroll: [Zab: High-performance broadcast for primary-backup systems -](zab-high-performance-broadcast-for-primary-backup-systems.pdf) +* :scroll: [Zab: High-performance broadcast for primary-backup systems](zab-high-performance-broadcast-for-primary-backup-systems.pdf) * :scroll: [ZooKeeper: Wait-free coordination for Internet-scale systems](zookeeper-wait-free-coordination-for-internet-scale-systems.pdf)