All-or-Nothing Publish Runbook

All-or-Nothing Publish Runbook A workflow diagram generated by Archify. 01 / Job Driver 02 / Workers 03 / Store + Reader Publish gate Job Start · immutable input shards · Job Driver Job Start immutable input shards Retry Order · delete partial, fresh id · Job Driver Retry Order delete partial, fresh id All-Tasks Barrier · every task committed · Job Driver › Publish gate · no partial publish All-Tasks Barrier every task committed no partial publish Publish Manifest · swap CURRENT pointer · Job Driver › Publish gate Publish Manifest swap CURRENT pointer Run Attempts · write attempt files · Workers Run Attempts write attempt files Attempt Files · checksummed, invisible · Store + Reader Attempt Files checksummed, invisible Old Versions · kept until GC · Store + Reader Old Versions kept until GC Version Pointer · CURRENT manifest · Store + Reader · atomic swap Version Pointer CURRENT manifest atomic swap Pinned Reader · reads one manifest · Store + Reader Pinned Reader reads one manifest all committed checksum fails freeze shards previous kept CURRENT points at v3 rerun from split read pinned version swap pointer write attempts Legend Agent logic Context / trace External system