A daily orders pipeline ran green every night last week

A medium Pipeline Design interview practice problem on DataDriven. Write and execute real pipeline design code with instant grading.

Domain

Pipeline Design

Difficulty

medium

Problem

A daily orders pipeline ran green every night last week. Finance noticed Friday that revenue dropped 12 percent on Tuesday and stayed low. The cause: a Kafka partition silently dropped events for six hours; the pipeline read every event that was present and exited zero. Operational success and semantic failure coexisted. The section's point is that green orchestrator runs do not prove the data is correct. Spot the silent failure by adding a quality gate between the transform and the mart, plus a paging destination so the gate's verdict reaches a human.

Practice This Problem

Solve this Pipeline Design problem with real code execution. DataDriven runs your solution and grades it automatically.