Two streaming aggregators sit at opposite ends of the idempotency-cost spectrum, and their architect

A medium Pipeline Design interview practice problem on DataDriven. Write and execute real pipeline design code with instant grading.

Domain

Pipeline Design

Difficulty

medium

Problem

Two streaming aggregators sit at opposite ends of the idempotency-cost spectrum, and their architectures have been swapped. A financial-close pipeline whose output feeds an SEC report writes to a Redis counter; a real-time page-view counter for a five-second engagement dashboard runs Flink 2PC into Iceberg. Apply the section's three-question decision framework and put each aggregator on the architecture its use case actually justifies.

Practice This Problem

Solve this Pipeline Design problem with real code execution. DataDriven runs your solution and grades it automatically.