A daily orders aggregation works fine when nothing goes wrong

A medium Pipeline Design interview practice problem on DataDriven. Write and execute real pipeline design code with instant grading.

Domain

Pipeline Design

Difficulty

medium

Problem

A daily orders aggregation works fine when nothing goes wrong. Tonight at 3am the on-call engineer gets paged: the dashboard is empty. Stdout from the run scrolled past hours ago, no run identifier ties one log line to a specific run, and the only failure signal is a nonzero exit code nobody is watching. The section names five things a script lacks (run identity, durable visibility, failure signal, recovery, idempotent restart). Spot the operability gap by adding the operational shell on the canvas: a structured-log destination, a metric-store destination, a paging destination, and a heartbeat that lets on-call see the pipeline is making progress.

Practice This Problem

Solve this Pipeline Design problem with real code execution. DataDriven runs your solution and grades it automatically.