Out of the Data Center
A medium Pipeline Design mock interview question on DataDriven, with an AI interviewer who asks follow-up questions and a hire or no-hire decision at the end.
- Domain
- Pipeline Design
- Difficulty
- medium
- Seniority
- L6
Interview Prompt
How should the platform lead move about 150 daily pipelines, roughly 500 GB a day, from an on-prem warehouse that can't scale into a cloud warehouse, a few pipelines at a time? Until a pipeline cuts over, its on-prem jobs keep loading the on-prem warehouse that about 200 analysts read their daily reports from.
Summary
The on-prem servers are not getting any younger.
How This Interview Works
- Read the vague prompt (just like a real interview)
- Ask clarifying questions to the AI interviewer
- Draw your pipeline on the design canvas: sources, transforms, storage and checks
- Answer the interviewer's follow-up questions, then get a hire or no-hire decision