Nightly Exports Are Too Slow
A medium Pipeline Design mock interview question on DataDriven, with an AI interviewer who asks follow-up questions and a hire or no-hire decision at the end.
- Domain
- Pipeline Design
- Difficulty
- medium
- Seniority
- L5
Interview Prompt
The claims, member and provider databases run on three different engines and take about 225K changes a day, and their owners will grant replication access to the transaction logs but nothing else. The platform lead needs a pipeline that retires the six-hour nightly export into the analytics warehouse: design it.
Summary
Healthcare claims change constantly. The warehouse cannot fall behind.
How This Interview Works
- Read the vague prompt (just like a real interview)
- Ask clarifying questions to the AI interviewer
- Draw your pipeline on the design canvas: sources, transforms, storage and checks
- Answer the interviewer's follow-up questions, then get a hire or no-hire decision