DataDriven
LearnPracticeInterviewDiscussDailyJobs

A backend team shipped a new field on the checkout_completed event Tuesday afternoon: discount_code_

A medium Pipeline Design interview practice problem on DataDriven. Write and execute real pipeline design code with instant grading.

Domain
Pipeline Design
Difficulty
medium

Problem

A backend team shipped a new field on the checkout_completed event Tuesday afternoon: discount_code_applied. The pipeline's loader has been writing to a strict-schema target table for six months and started failing the moment the new field appeared. The section names three reactions a loader can have to an unexpected field (reject, silent drop, accept), and the canonical fix is to land the raw payload in a flexible format so the new shape does not crash the pipeline. Spot the broken loader on the canvas: replace the strict-schema warehouse loader and target with a destination that accepts the variant payload (a JSON or VARIANT column in Snowflake or BigQuery, an Avro-tagged record on a topic backed by a schema registry, or a lakehouse table format whose schema_evolution lets new columns appear without a rewrite). The downstream dashboard must read from the new destination.

Practice This Problem

Solve this Pipeline Design problem with real code execution. DataDriven runs your solution and grades it automatically.

Related

  • All Practice Problems
  • Mock Interview Mode
  • System Design Interview Questions
  • Data Engineering Interview Prep Guide
  • Daily Challenge
  • Data Engineering Lessons