Sixty Minutes, Every Hour
A medium Pipeline Design interview practice problem on DataDriven. Write and execute real pipeline design code with instant feedback.
- Domain
- Pipeline Design
- Difficulty
- medium
- Seniority
- L6
Problem
We run an OLTP database behind a customer-facing app, and the analytics team needs its data in the warehouse within an hour of every change, refreshed on the hour. Design a pipeline that pulls source changes without loading the live database, exposes each hour to consumers all at once so a dashboard never reads a half-updated hour, and can replay missed windows after an outage without dropping or double-counting rows. Deletes at the source, including GDPR erasures, must stop the record from being queryable.
Summary
Every hour, on the hour. No excuses.
Practice This Problem
Solve this Pipeline Design problem with real code execution. DataDriven runs your solution and checks it automatically.