The Migration That Cannot Break Morning

A hard Pipeline Design interview practice problem on DataDriven. Write and execute real pipeline design code with instant feedback.

Domain

Pipeline Design

Difficulty

hard

Seniority

L5

Problem

Our data platform grew on-premises over many years, and the business is moving all of it to the cloud while the morning reports keep running every day. Design an architecture for the migration itself, where the on-prem pipelines and their cloud replacements run side by side, their outputs are reconciled before anything switches over, and any single pipeline can be pointed back to on-prem if its cloud version misbehaves.

Summary

It all works today. Moving it without losing a single report is the hard part.

Practice This Problem

Solve this Pipeline Design problem with real code execution. DataDriven runs your solution and checks it automatically.