Systems & Distributed Dynamo: Amazon's Highly Available Key-value Store Amazon's shopping cart can never say no. This paper shows how Dynamo trades strict consistency for always-on availability using consistent hashing, sloppy quorums, and vector clocks, the same ideas behind Cassandra and Riak today.
Giuseppe DeCandia, Werner Vogels et al. · SOSP 2007
AI & ML Adam: A Method for Stochastic Optimization A single global learning rate is a poor fit for millions of parameters with wildly different gradient behavior. Adam gives every parameter its own adaptive learning rate by combining momentum with a bias-corrected running average of squared gradients, and became deep learning's default optimizer.
Diederik P. Kingma, Jimmy Ba · ICLR 2015
Systems & Distributed In Search of an Understandable Consensus Algorithm (Raft) Paxos works, but almost nobody can explain it cleanly. Raft gets the same guarantees by splitting consensus into leader election, log replication, and safety, the algorithm now running underneath etcd, Consul, and Kubernetes.
Diego Ongaro, John Ousterhout · USENIX ATC 2014
