A 200-engineer growth-stage company has accumulated 53 transforms and 100 dashboards with no shared

A medium Pipeline Design interview practice problem on DataDriven. Write and execute real pipeline design code with instant grading.

Domain

Pipeline Design

Difficulty

medium

Problem

A 200-engineer growth-stage company has accumulated 53 transforms and 100 dashboards with no shared layers; three teams compute weekly active users with different numbers. The new head of data engineering wants the smallest set of changes that makes the system operable. Apply every intermediate-tier framing the section taught: shared layered architecture, the right ETL or ELT choice per transform, one orchestrator owning the DAG, freshness cadence visible per source, and the ML branch split downstream of the curated layer.

Practice This Problem

Solve this Pipeline Design problem with real code execution. DataDriven runs your solution and grades it automatically.