The Provider That Sometimes Sleeps
A medium Pipeline Design mock interview question on DataDriven. Practice with AI-powered feedback, real code execution, and a hire/no-hire decision.
- Domain
- Pipeline Design
- Difficulty
- medium
- Seniority
- L5
Interview Prompt
Our quantitative research team runs pre-market models each morning on the prior day's price and volume data, pulled daily from a paid external provider whose manual pull process has already cost us missed trading sessions. The provider bills per request and goes dark for hours at a time, and our licensing terms require every raw file we receive to be kept unchanged for audit. Design an automated ingestion pipeline that lands the data on time, keeps every raw file for audit, rides out the provider's outages without draining the paid request budget, and gets a failed or late pull in front of the team before the quants hit it at model-run time.
Summary
The models run at dawn. The data has to be there first.
How This Interview Works
- Read the vague prompt (just like a real interview)
- Ask clarifying questions to the AI interviewer
- Write your pipeline design solution with real code execution
- Get instant feedback and a hire/no-hire decision