Replicate It Without Breaking It
A hard Pipeline Design mock interview question on DataDriven, with an AI interviewer who asks follow-up questions and a hire or no-hire decision at the end.
- Domain
- Pipeline Design
- Difficulty
- hard
- Seniority
- L6
Interview Prompt
What streaming pipeline keeps a Delta lake continuously replicated from an OLTP database taking about 200K writes a minute at peak, so the analyst querying it never touches production? Two of its 50 tables, orders and order line items, carry 80% of those writes.
Summary
The source changed. The lake needs to know immediately.
How This Interview Works
- Read the vague prompt (just like a real interview)
- Ask clarifying questions to the AI interviewer
- Draw your pipeline on the design canvas: sources, transforms, storage and checks
- Answer the interviewer's follow-up questions, then get a hire or no-hire decision