Chapter 11 map: batch processing
Chapter 11 map
Unix pipeline
pipes on one machine
Distributed OS
storage, schedulers, tasks
MapReduce
map, implicit sort, reduce
Batch processing
immutable in, derived out
Shuffle
the distributed sort
Dataflow and SQL
one job, pipelined
Serve the output
streams, all-or-nothing