Partition Everywhere the Same, Sort Locally

Partition Everywhere the Same, Sort Locally A data-flow diagram generated by Archify. 01 / Splits 02 / Mappers 03 / Partition 04 / Files Input Splits · one per mapper · 01 / Splits Input Splits one per mapper Mapper 1 · hash + local sort · 02 / Mappers Mapper 1 hash + local sort Mapper 2 · hash + local sort · 02 / Mappers Mapper 2 hash + local sort Partitioner · floorMod(hash, R) · 03 / Partition · stable Partitioner floorMod(hash, R) stable Map-Output Files · sorted mPrR files · 04 / Files Map-Output Files sorted mPrR files read split immutable lines read split immutable lines keyed records keyed records keyed records keyed records sorted partition files sorted mPrR files Legend primary data data store