A four-year-old Kafka topic carries customer events with no formal schema, three named consumers, an
A medium Pipeline Design interview practice problem on DataDriven. Write and execute real pipeline design code with instant grading.
- Domain
- Pipeline Design
- Difficulty
- medium
Problem
A four-year-old Kafka topic carries customer events with no formal schema, three named consumers, and an unknown number of analyst queries. One wrong-number incident every six to eight weeks. Producers have added and renamed fields without coordination. The section's rollout is four steps: document the current contract (1.0.0) capturing reality not aspiration, inventory every consumer, observe the contract in shadow mode before enforcing, then migrate behind versioned changes. Plan the rollout by adding the four-step pipeline to the canvas: a documented-contract artifact, a consumer-inventory artifact, a shadow-mode observation transform, and a versioned-enforcement gate that activates only after the inventory and observation steps complete.
Practice This Problem
Solve this Pipeline Design problem with real code execution. DataDriven runs your solution and grades it automatically.