DataDriven
LearnPracticeInterviewDiscussDailyJobs

The team replaced the cron chain from the previous section with an Airflow orchestrator and three sm

A medium Pipeline Design interview practice problem on DataDriven. Write and execute real pipeline design code with instant grading.

Domain
Pipeline Design
Difficulty
medium

Problem

The team replaced the cron chain from the previous section with an Airflow orchestrator and three small Python tasks: extract_orders, clean_orders, and aggregate_orders. The orchestrator and the three task nodes are on the canvas, but no dependency edges have been drawn yet, so Airflow does not know what runs after what. Apply the DAG framing this section just taught. Draw the directed edges so the graph encodes the temporal order: Postgres source feeds extract_orders, extract_orders points to clean_orders, clean_orders points to aggregate_orders, and aggregate_orders writes to the Snowflake daily_orders mart. The Morning dashboard reads from the mart. Every edge points from upstream to downstream. The graph must have no cycles; the section is explicit that an edge pointing back into an earlier task is the failure mode that makes the DAG unschedulable.

Practice This Problem

Solve this Pipeline Design problem with real code execution. DataDriven runs your solution and grades it automatically.

Related

  • All Practice Problems
  • Mock Interview Mode
  • System Design Interview Questions
  • Data Engineering Interview Prep Guide
  • Daily Challenge
  • Data Engineering Lessons