A new pipeline does not need fifty monitors
A medium Pipeline Design mock interview question on DataDriven. Practice with AI-powered feedback, real code execution, and a hire/no-hire decision.
- Domain
- Pipeline Design
- Difficulty
- medium
Interview Prompt
A new pipeline does not need fifty monitors. The section names three day-one monitors that catch most failures in the first month: did it run (no run record exists for today), did it succeed (run exists but exited non-zero), and was the output the right size (run succeeded but row count fell outside the expected band). Together they catch scheduler outages, code errors, source schema changes, silent filters, and partial extracts. Choose the day-one monitors by adding three monitor transforms downstream of the orchestrator and the destination, one per question, each with the metric source and a paging destination wired.
How This Interview Works
- Read the vague prompt (just like a real interview)
- Ask clarifying questions to the AI interviewer
- Write your pipeline design solution with real code execution
- Get instant feedback and a hire/no-hire decision