DataDrivenDataDriven
LearnPracticeInterviewDailyJobsCommunity

Sixty Minutes, Every Hour

A medium Pipeline Design interview practice problem on DataDriven. Write and execute real pipeline design code with instant feedback.

Domain
Pipeline Design
Difficulty
medium
Seniority
L6

Problem

We run an OLTP database behind a customer-facing app, and the analytics team needs its data in the warehouse within an hour of every change, refreshed on the hour. Design a pipeline that pulls source changes without loading the live database, exposes each hour to consumers all at once so a dashboard never reads a half-updated hour, and can replay missed windows after an outage without dropping or double-counting rows. Deletes at the source, including GDPR erasures, must stop the record from being queryable.

Summary

Every hour, on the hour. No excuses.

Practice This Problem

Solve this Pipeline Design problem with real code execution. DataDriven runs your solution and checks it automatically.

Related

  • All Practice Problems
  • Mock Interview Mode
  • System Design Interview Questions
  • Data Engineering Interview Prep Guide
  • Daily Challenge
  • Data Engineering Lessons