Five Years of Cron Jobs
A hard Pipeline Design mock interview question on DataDriven, with an AI interviewer who asks follow-up questions and a hire or no-hire decision at the end.
- Domain
- Pipeline Design
- Difficulty
- hard
- Seniority
- L6
Interview Prompt
Our data platform grew over five years into a mix of on-premises cron jobs and pipelines triggered by upstream system callbacks, and it all has to move to one cloud-native orchestration platform while the legacy runs stay live until each pipeline proves out. Design the migration architecture and the run logging and observability schema behind it.
Summary
Half the jobs run on cron. Half run on events. All of it has to move.
How This Interview Works
- Read the vague prompt (just like a real interview)
- Ask clarifying questions to the AI interviewer
- Draw your pipeline on the design canvas: sources, transforms, storage and checks
- Answer the interviewer's follow-up questions, then get a hire or no-hire decision