Pipeline cost grows monotonically unless something pushes back

A medium Pipeline Design interview practice problem on DataDriven. Write and execute real pipeline design code with instant grading.

Domain

Pipeline Design

Difficulty

medium

Problem

Pipeline cost grows monotonically unless something pushes back. Reactive cost work, kicked off when the bill becomes alarming, costs more than proactive cost work. The section's five levers: storage tiering (cold partitions to cheaper classes), partition pruning audits (queries scanning more partitions than they need), materialized view ROI (drop views whose maintenance exceeds their query savings), warehouse right-sizing (downsize compute on workloads that no longer need it), and query rewriting (the heaviest queries by spend). Pick the next cost lever by adding a cost-rhythm transform whose name states the monthly cadence, the lever audit that runs each month, and the accountability artifact (a cost owner per pipeline tier).

Practice This Problem

Solve this Pipeline Design problem with real code execution. DataDriven runs your solution and grades it automatically.