A Debezium connector against a Postgres logical replication slot has filled the source database disk

A medium Pipeline Design interview practice problem on DataDriven. Write and execute real pipeline design code with instant grading.

Domain

Pipeline Design

Difficulty

medium

Problem

A Debezium connector against a Postgres logical replication slot has filled the source database disk twice in the last six months. Each time the connector restarted and never reattached cleanly, and the WAL grew until on-call manually intervened. The section's mechanics: log-based CDC requires an initial snapshot, the slot retains WAL until the consumer confirms read, and stuck consumers cause WAL growth on the source. Place the slot by replacing the Debezium transform with one whose name states the initial snapshot phase, the slot lag monitor (with a budget and an alert threshold), and the schema-evolution policy (additive flows; destructive blocks).

Practice This Problem

Solve this Pipeline Design problem with real code execution. DataDriven runs your solution and grades it automatically.