A SaaS team built two pipelines off one Kafka topic: Dashboard ETL and Feature ETL each pull from Ka
A medium Pipeline Design interview practice problem on DataDriven. Write and execute real pipeline design code with instant grading.
- Domain
- Pipeline Design
- Difficulty
- medium
Problem
A SaaS team built two pipelines off one Kafka topic: Dashboard ETL and Feature ETL each pull from Kafka independently. Last week Feature ETL filtered out bot traffic, Dashboard ETL did not, and the two views drifted; the bot-filter logic now exists in two places. Apply the section's split-in-curated framing so Kafka is consumed once into a shared raw zone, one curated transform owns bot filtering, and the two consumer-shaped paths branch from the curated layer.
Practice This Problem
Solve this Pipeline Design problem with real code execution. DataDriven runs your solution and grades it automatically.