A SaaS company loads two million customer events per day across four event types into curated.fct_cu

A medium Pipeline Design interview practice problem on DataDriven. Write and execute real pipeline design code with instant grading.

Domain

Pipeline Design

Difficulty

medium

Problem

A SaaS company loads two million customer events per day across four event types into curated.fct_customer_events. The table feeds a dashboard, a churn model, and a billing report. The section's deliverable is a quality suite covering all five pillars: freshness (MAX(event_timestamp) within 2 hours), volume (row count vs day-of-week baseline), distribution (amount_usd z-shift, event_type category mix within 5 percentage points), schema (declared columns, types, nullability), and lineage hint (which upstream column produced which output column). Compose the five-pillar suite by adding five quality-check transforms, one per pillar, each with assertion and threshold visible, and routing block-class fires to a paging destination.

Practice This Problem

Solve this Pipeline Design problem with real code execution. DataDriven runs your solution and grades it automatically.