Greenfield Build for Six Sources
A hard Pipeline Design mock interview question on DataDriven. Practice with AI-powered feedback, real code execution, and a hire/no-hire decision.
- Domain
- Pipeline Design
- Difficulty
- hard
- Seniority
- L5
Interview Prompt
We're standing up a fresh data platform on Databricks: six sources that need to be ingested, transformed through medallion layers, and served to business analysts through one consistent semantic layer. Analysts open dashboards at 8am every weekday, so every pipeline feeding them must complete by 7:30am and alert the moment a source is at risk of missing that window. Leadership currently sees a different revenue number in every meeting because each analyst writes their own KPI SQL, and finance analysts must never see raw card data from the payments feed, so every consumer has to read the metrics through a governance layer that enforces column-level access rather than off the tables directly. Design the end-to-end platform: the infrastructure-as-code config for each source, the orchestration DAG, one canonical definition per KPI in the semantic layer, and the governance checkpoint that sits between the serving layer and the dashboards to enforce column-level access.
Summary
Infrastructure as code. Meaning as a service.
How This Interview Works
- Read the vague prompt (just like a real interview)
- Ask clarifying questions to the AI interviewer
- Write your pipeline design solution with real code execution
- Get instant feedback and a hire/no-hire decision