Redesign a clickstream pipeline so the next latency spike, schema drift, credential rotation, downst

A medium Pipeline Design interview practice problem on DataDriven. Write and execute real pipeline design code with instant grading.

Domain

Pipeline Design

Difficulty

medium

Problem

Redesign a clickstream pipeline so the next latency spike, schema drift, credential rotation, downstream outage, and producer-side burst do not cause an outage. Compose every advanced-tier pattern: failure-surface classification on each node; retry budget plus circuit breaker around every external call; DLQ with envelope; DLQ-as-quality-signal monitoring (rate by exception type with z-score alerts); DLQ replay tooling with a second-failure side channel; bounded queues with backpressure; load-shedding on the source side. Route the dashboard through the resilient path.

Practice This Problem

Solve this Pipeline Design problem with real code execution. DataDriven runs your solution and grades it automatically.