Doubling Every Six Months

A hard Pipeline Design interview practice problem on DataDriven. Write and execute real pipeline design code with instant grading.

Domain

Pipeline Design

Difficulty

hard

Seniority

L7

Problem

We're a fast-growing marketplace and our data volume has been doubling every six months. We keep throwing more servers at the problem but it doesn't scale and the costs are exploding. Three teams read this data on completely different cadences (operations live, analytics hourly, data science weekly), flash sales drive 10x traffic spikes that take hours to recover from, and three new enterprise customers signed contracts requiring their data be kept separate from everyone else's. Design a pipeline that scales automatically without manual provisioning, brings cost per unit down as we grow, and holds all three constraints at once.

Summary

Tuesdays are quiet. Black Friday is not.

Practice This Problem

Solve this Pipeline Design problem with real code execution. DataDriven runs your solution and grades it automatically.