# A new pipeline does not need fifty monitors

Canonical URL: <https://datadriven.io/problems/a-new-pipeline-does-not-need-fifty-monitors-the-section-nam-95689f06>

Domain: Pipeline Design · Difficulty: medium

## Problem

A new pipeline does not need fifty monitors. The section names three day-one monitors that catch most failures in the first month: did it run (no run record exists for today), did it succeed (run exists but exited non-zero), and was the output the right size (run succeeded but row count fell outside the expected band). Together they catch scheduler outages, code errors, source schema changes, silent filters, and partial extracts. Choose the day-one monitors by adding three monitor transforms downstream of the orchestrator and the destination, one per question, each with the metric source and a paging destination wired.

## Related

- [All practice problems](https://datadriven.io/problems)
- [Mock interview mode](https://datadriven.io/interview/a-new-pipeline-does-not-need-fifty-monitors-the-section-nam-95689f06)
- [System Design Interview Questions](https://datadriven.io/data-engineering-system-design)
- [Data Engineering Interview Prep Guide](https://datadriven.io/data-engineer-interview-prep)
- [Daily Challenge](https://datadriven.io/daily)

---

Source: DataDriven (https://datadriven.io). 100% free data engineering interview prep. Live code execution against Postgres 16, Python 3.11, and Spark sandboxes. No paywall, no premium tier, no signup gate.