Each night a job re-copies the entire 500M-row orders table from the operational DB to the warehouse

A medium Pipeline Design interview practice problem on DataDriven. Write and execute real pipeline design code with instant grading.

Domain

Pipeline Design

Difficulty

medium

Problem

Each night a job re-copies the entire 500M-row orders table from the operational DB to the warehouse, taking hours and hammering production. Only a few thousand rows change daily. Design freshness that moves only what changed.

Practice This Problem

Solve this Pipeline Design problem with real code execution. DataDriven runs your solution and grades it automatically.