Six Million Rows Before the Market Opens
A medium Pipeline Design mock interview question on DataDriven, with an AI interviewer who asks follow-up questions and a hire or no-hire decision at the end.
- Domain
- Pipeline Design
- Difficulty
- medium
- Seniority
- L5
Interview Prompt
A third-party vendor drops a dirty CSV of 6 million time series price rows over SFTP each morning, and the quant team's pre-market models read it from the warehouse. Design the ingestion architecture from the vendor drop through to the quant query surface.
Summary
One massive CSV. Millions of timestamps.
How This Interview Works
- Read the vague prompt (just like a real interview)
- Ask clarifying questions to the AI interviewer
- Draw your pipeline on the design canvas: sources, transforms, storage and checks
- Answer the interviewer's follow-up questions, then get a hire or no-hire decision