A public health-tech company has run on a 1.4 PB Snowflake warehouse plus a separate 6 PB raw S3 lak

A medium Pipeline Design interview practice problem on DataDriven. Write and execute real pipeline design code with instant grading.

Domain

Pipeline Design

Difficulty

medium

Problem

A public health-tech company has run on a 1.4 PB Snowflake warehouse plus a separate 6 PB raw S3 lake for four years. Two answers exist for every metric and storage costs grew 4x year over year. The new chief data officer commits to a unified lakehouse architecture. Apply the entire L3 tier so a single lakehouse archive feeds the warehouse mart, ML training, and regulator audits, with the operational app keeping its own store and a compaction job keeping file size in target.

Practice This Problem

Solve this Pipeline Design problem with real code execution. DataDriven runs your solution and grades it automatically.