45 Minutes Turned Into 3.5 Hours
A medium Pipeline Design mock interview question on DataDriven. Practice with AI-powered feedback, real code execution, and a hire/no-hire decision.
- Domain
- Pipeline Design
- Difficulty
- medium
- Seniority
- L5
Interview Prompt
We run a Databricks platform for bank transaction analytics, where a daily aggregation must land before the 6am risk dashboard. That job should take 45 minutes but now runs 3.5 hours and misses the deadline, and weeks of adding compute have not helped. Design the scheduled pipeline and remediation plan that gets the run back under SLA, alerts on-call before 6am if the run is at risk, and keeps the queryable output feeding the dashboard.
Summary
Spark jobs are running. Just not fast enough.
How This Interview Works
- Read the vague prompt (just like a real interview)
- Ask clarifying questions to the AI interviewer
- Write your pipeline design solution with real code execution
- Get instant feedback and a hire/no-hire decision