# Redesign a clickstream pipeline so the next latency spike, schema drift, credential rotation, downst

Canonical URL: <https://datadriven.io/problems/redesign-a-clickstream-pipeline-so-the-next-latency-spike-s-5e115682>

Domain: Pipeline Design · Difficulty: medium

## Problem

Redesign a clickstream pipeline so the next latency spike, schema drift, credential rotation, downstream outage, and producer-side burst do not cause an outage. Compose every advanced-tier pattern: failure-surface classification on each node; retry budget plus circuit breaker around every external call; DLQ with envelope; DLQ-as-quality-signal monitoring (rate by exception type with z-score alerts); DLQ replay tooling with a second-failure side channel; bounded queues with backpressure; load-shedding on the source side. Route the dashboard through the resilient path.

## Related

- [All practice problems](https://datadriven.io/problems)
- [Mock interview mode](https://datadriven.io/interview/redesign-a-clickstream-pipeline-so-the-next-latency-spike-s-5e115682)
- [System Design Interview Questions](https://datadriven.io/data-engineering-system-design)
- [Data Engineering Interview Prep Guide](https://datadriven.io/data-engineer-interview-prep)
- [Daily Challenge](https://datadriven.io/daily)

---

Source: DataDriven (https://datadriven.io). 100% free data engineering interview prep. Live code execution against Postgres 16, Python 3.11, and Spark sandboxes. No paywall, no premium tier, no signup gate.