A clickstream pipeline lands billions of raw mobile-event JSON records straight into Snowflake at $2

A medium Pipeline Design interview practice problem on DataDriven. Write and execute real pipeline design code with instant grading.

Domain

Pipeline Design

Difficulty

medium

Problem

A clickstream pipeline lands billions of raw mobile-event JSON records straight into Snowflake at $23/TB/month. The volume is approaching petabyte scale and warehouse storage costs are becoming absurd. Apply the section's data-lake framing and split the storage by zone so the bulk raw volume lives in the shape the section names for cheap immutable retention, with the warehouse loading only the curated mart.

Practice This Problem

Solve this Pipeline Design problem with real code execution. DataDriven runs your solution and grades it automatically.