A Stream All Day and a File at Midnight
A hard Pipeline Design mock interview question on DataDriven, with an AI interviewer who asks follow-up questions and a hire or no-hire decision at the end.
- Domain
- Pipeline Design
- Difficulty
- hard
- Seniority
- L7
Interview Prompt
Transactions arrive as a continuous stream all day, and a daily reconciliation file lands at midnight that corrects the prior day's activity. Both feeds have to land in one warehouse that the analysts query. Design the pipeline that carries both.
Summary
Real-time and batch. Same pipeline. No compromises.
How This Interview Works
- Read the vague prompt (just like a real interview)
- Ask clarifying questions to the AI interviewer
- Draw your pipeline on the design canvas: sources, transforms, storage and checks
- Answer the interviewer's follow-up questions, then get a hire or no-hire decision