A single consumer can't keep up with a 16-partition topic and lag is growing

A medium Pipeline Design interview practice problem on DataDriven. Write and execute real pipeline design code with instant grading.

Domain

Pipeline Design

Difficulty

medium

Problem

A single consumer can't keep up with a 16-partition topic and lag is growing. Naively running two copies makes both read everything and double-process. Design consumption that scales horizontally without double-processing or losing offsets on restart.

Practice This Problem

Solve this Pipeline Design problem with real code execution. DataDriven runs your solution and grades it automatically.