Consume-commit loop: the assembly that holds exactly-once together

Consume-commit loop: the assembly that holds exactly-once together A workflow diagram generated by Archify. 01 / Consume + Fence 02 / Record DB EX / Rebalance + Repair Poll Guard + apply Commit Poll partition · ordered batch · Consume + Fence › Poll Poll partition ordered batch Fence check · epoch = owner? · Consume + Fence › Guard + apply Fence check epoch = owner? Idempotent apply · offset > last? · Consume + Fence › Guard + apply Idempotent apply offset > last? Advance · repeat per batch · Consume + Fence › Commit Advance repeat per batch Atomic commit · totals + ckpt · Record DB › Commit Atomic commit totals + ckpt Offset jump · alert + re-seed · Rebalance + Repair › Poll Offset jump alert + re-seed Stale owner · write fenced · Rebalance + Repair › Guard + apply Stale owner write fenced Partition move · versioned routing · Rebalance + Repair › Guard + apply Partition move versioned routing Rebalance abort · txn rolled back · Rebalance + Repair › Commit Rebalance abort txn rolled back offset > last all or nothing rebalance aborts txn epoch = owner epoch mismatch batch offset out of range ownership moved Legend Agent logic Policy Tool action Context / trace