DataDriven
LearnPracticeInterviewDiscussDailyJobs

Three failures on the canvas should not be retried

A medium Pipeline Design interview practice problem on DataDriven. Write and execute real pipeline design code with instant grading.

Domain
Pipeline Design
Difficulty
medium

Problem

Three failures on the canvas should not be retried. A validation failure (a required field missing from an event) sees the same missing field on attempt two. An authentication failure (HTTP 401) keeps failing with the same wrong credential and can lock the account out. A poison pill (a Kafka message that crashes the worker every time it is pulled) loops forever, blocking every other downstream message behind it. The section's rule: if retrying does not change anything between attempts, retrying is the wrong tool. Add three terminal destinations downstream of the worker, one per failure type, so the queue keeps flowing.

Practice This Problem

Solve this Pipeline Design problem with real code execution. DataDriven runs your solution and grades it automatically.

Related

  • All Practice Problems
  • Mock Interview Mode
  • System Design Interview Questions
  • Data Engineering Interview Prep Guide
  • Daily Challenge
  • Data Engineering Lessons