CDC pipeline: outbox events, compacted state, and a snapshot at LSN B

CDC pipeline: outbox events, compacted state, and a snapshot at LSN B A data-flow diagram generated by Archify. 01 / Record 02 / Capture 03 / Stream 04 / Build 05 / Serve OLTP record · single leader · 01 / Record · decides order OLTP record single leader decides order Consistent snapshot · at LSN B · 01 / Record · throttled Consistent snapshot at LSN B throttled Outbox table · same txn · 02 / Capture · public contract Outbox table same txn public contract CDC relay · outbox router · 02 / Capture · Debezium-style CDC relay outbox router Debezium-style Outbox events · keyed by event id · 03 / Stream · append-only Outbox events keyed by event id append-only Entity state · keyed by entity key · 03 / Stream · compacted Entity state keyed by entity key compacted Indexer · dedup + apply · 04 / Build · idempotent Indexer dedup + apply idempotent Search index · derived view · 05 / Serve · follower Search index derived view follower business + outbox one txn outbox rows stable schema events append-only entity state upserts + tombstones bulk rows at LSN B bounded rate stream + dedup from LSN B full state scan seed / repair apply to index upserts + deletes Legend primary data policy / PII async batch data store