Sr. Data Engineer Top Tech Architecture
Libremax Capital45 Minutes Turned Into 3.5 Hours
Our bank runs a Databricks platform for transaction analytics. The pipelines are functional but slow - a daily job that should finish in 45 minutes is taking 3.5 hours, and the team has been throwing more compute at it without understanding the root cause. Design the optimized pipeline architecture and the performance remediation plan that resolves the Spark bottlenecks.
Ask the interviewer clarifying questions to understand the requirements and constraints before designing.
When you're ready, click Ready to Design to start building.
45 Minutes Turned Into 3.5 Hours
A medium Pipeline Design mock interview question on DataDriven. Practice with AI-powered feedback, real code execution, and a hire/no-hire decision.
- Domain
- Pipeline Design
- Difficulty
- medium
- Seniority
- senior
Interview Prompt
Our bank runs a Databricks platform for transaction analytics. The pipelines are functional but slow - a daily job that should finish in 45 minutes is taking 3.5 hours, and the team has been throwing more compute at it without understanding the root cause. Design the optimized pipeline architecture and the performance remediation plan that resolves the Spark bottlenecks.
How This Interview Works
- Read the vague prompt (just like a real interview)
- Ask clarifying questions to the AI interviewer
- Write your pipeline design solution with real code execution
- Get instant feedback and a hire/no-hire decision