DataDriven
LearnPracticeInterviewDiscussDailyJobs

An overnight ETL produced four kinds of errors last week: HTTP 503 from a downstream during a CPU sp

A medium Pipeline Design interview practice problem on DataDriven. Write and execute real pipeline design code with instant grading.

Domain
Pipeline Design
Difficulty
medium

Problem

An overnight ETL produced four kinds of errors last week: HTTP 503 from a downstream during a CPU spike, HTTP 401 because a service-account token expired, HTTP 429 from a rate limiter that returned a Retry-After header, and a JSON parse error on one malformed row out of two million. The section names two buckets (transient, permanent) plus a third pragmatic case (ambiguous). Classify the failure: add four classifier marker nodes downstream of the ingest transform, one per error, whose names state which bucket the error belongs to and the response that follows.

Practice This Problem

Solve this Pipeline Design problem with real code execution. DataDriven runs your solution and grades it automatically.

Related

  • All Practice Problems
  • Mock Interview Mode
  • System Design Interview Questions
  • Data Engineering Interview Prep Guide
  • Daily Challenge
  • Data Engineering Lessons