A hard Pipeline Design interview practice problem on DataDriven. Write and execute real pipeline design code with instant grading.

Domain

Pipeline Design

Difficulty

hard

Seniority

L7

Problem

Our e-commerce platform generates 600 million user interaction events per day through Kafka, and we need to store and serve this data for both real-time personalization and offline analytics teams. Current ad-hoc queries are scanning the entire dataset on every run. Design a storage and query architecture that supports both use cases cost-efficiently with two-year data retention.

Summary

600 million events a day. Two years of retention.

Practice This Problem

Solve this Pipeline Design problem with real code execution. DataDriven runs your solution and grades it automatically.