A Debezium CDC pipeline streams the payments database to a downstream Iceberg lakehouse and a regula

A medium Pipeline Design interview practice problem on DataDriven. Write and execute real pipeline design code with instant grading.

Domain

Pipeline Design

Difficulty

medium

Problem

A Debezium CDC pipeline streams the payments database to a downstream Iceberg lakehouse and a regulatory reporting system. A DBA runs ALTER TABLE on payments.transactions in production: add merchant_country (additive), drop legacy_clearing_code (destructive). Both schema-change events are already in the change stream. The section names three enforcement policies: allow-additive (additive changes flow through, destructive changes blocked), block-breaking (any non-additive change halts the stream and pages on-call), and quarantine (destructive changes route to a quarantine topic for human decision). Set the CDC schema policy by adding a policy enforcement transform between Debezium and the downstream consumers whose name states which of the three policies it applies, and add a quarantine destination for blocked changes.

Practice This Problem

Solve this Pipeline Design problem with real code execution. DataDriven runs your solution and grades it automatically.