45 Minutes Turned Into 3.5 Hours
A medium Pipeline Design mock interview question on DataDriven, with an AI interviewer who asks follow-up questions and a hire or no-hire decision at the end.
- Domain
- Pipeline Design
- Difficulty
- medium
- Seniority
- L5
Interview Prompt
Design the scheduled pipeline and remediation that land a daily bank-transaction aggregation on Databricks before the 6am risk dashboard reads its queryable output. The job should take 45 minutes but now runs 3.5 hours and misses that deadline.
Summary
Spark jobs are running. Just not fast enough.
How This Interview Works
- Read the vague prompt (just like a real interview)
- Ask clarifying questions to the AI interviewer
- Draw your pipeline on the design canvas: sources, transforms, storage and checks
- Answer the interviewer's follow-up questions, then get a hire or no-hire decision