The Analysts Cannot Touch Production

A medium Pipeline Design interview practice problem on DataDriven. Write and execute real pipeline design code with instant grading.

Domain

Pipeline Design

Difficulty

medium

Seniority

L5

Problem

Our product runs on a transactional database under constant write pressure, and the team that owns it will not allow analytics queries to run against it, so we need a separate warehouse that keeps up with every insert, update, and delete without those reads ever landing on the live database. The source is messy, with the same records spread across several tables under mismatched keys, and raw customer email and phone numbers cannot sit in the warehouse, so everything has to be normalized, combined, and masked before analysts can trust a report. Analysts open their dashboards at 4am, so an orchestrated overnight refresh has to finish before that window and raise an alert if any stage falls behind.

Summary

Production is the source. Analytics needs its own copy.

Practice This Problem

Solve this Pipeline Design problem with real code execution. DataDriven runs your solution and grades it automatically.