The day-one monitors cover freshness and volume but leave three blind spots

A medium Pipeline Design interview practice problem on DataDriven. Write and execute real pipeline design code with instant grading.

Domain

Pipeline Design

Difficulty

medium

Problem

The day-one monitors cover freshness and volume but leave three blind spots. The section's framework adds schema (column added, dropped, retyped upstream), distribution (mean shift, null rate spike, new categorical value), and lineage (which downstream consumers does this break). Together the five pillars turn a single-pipeline view into a fleet-level view. Map signals to the five pillars by adding five monitor transforms on the curated table fct_orders, one per pillar, each with a tech that fits the pillar's check, and route the lineage pillar through a catalog node that captures column-to-column provenance.

Practice This Problem

Solve this Pipeline Design problem with real code execution. DataDriven runs your solution and grades it automatically.