Three failures on the canvas should not be retried
A medium Pipeline Design interview practice problem on DataDriven. Write and execute real pipeline design code with instant grading.
- Domain
- Pipeline Design
- Difficulty
- medium
Problem
Three failures on the canvas should not be retried. A validation failure (a required field missing from an event) sees the same missing field on attempt two. An authentication failure (HTTP 401) keeps failing with the same wrong credential and can lock the account out. A poison pill (a Kafka message that crashes the worker every time it is pulled) loops forever, blocking every other downstream message behind it. The section's rule: if retrying does not change anything between attempts, retrying is the wrong tool. Add three terminal destinations downstream of the worker, one per failure type, so the queue keeps flowing.
Practice This Problem
Solve this Pipeline Design problem with real code execution. DataDriven runs your solution and grades it automatically.