DataDriven
LearnPracticeInterviewDiscussDailyJobs

An advanced pipeline treats failure classification as the design constraint that drives every retry,

A medium Pipeline Design interview practice problem on DataDriven. Write and execute real pipeline design code with instant grading.

Domain
Pipeline Design
Difficulty
medium

Problem

An advanced pipeline treats failure classification as the design constraint that drives every retry, breaker, queue, and runbook decision, not as a try/except clause bolted onto whichever surface broke last week. Each node has three failure surfaces: read (source unavailable, auth expired, schema changed), processing (bug, memory, poison pill, dependency failure), and write (destination unavailable, constraint violated, partition locked). Map the failure surface by adding three classifier markers, one per surface, each naming the failure modes for that surface and the matching response (retry budget, quarantine, breaker, DLQ, alert).

Practice This Problem

Solve this Pipeline Design problem with real code execution. DataDriven runs your solution and grades it automatically.

Related

  • All Practice Problems
  • Mock Interview Mode
  • System Design Interview Questions
  • Data Engineering Interview Prep Guide
  • Daily Challenge
  • Data Engineering Lessons