DataDriven
LearnPracticeInterviewDiscussDailyJobs

The exercise builds a complete first quality gate as a SQL assertion wired into a DAG

A medium Pipeline Design interview practice problem on DataDriven. Write and execute real pipeline design code with instant grading.

Domain
Pipeline Design
Difficulty
medium

Problem

The exercise builds a complete first quality gate as a SQL assertion wired into a DAG. The target table is mart.daily_orders, produced once per day at 2am. The assertion is that today's row count must fall between 50 percent and 200 percent of the same-day-of-week average over the trailing 8 weeks. The gate is a SQL query the orchestrator runs after the transform; pass lets downstream proceed, fail halts the DAG. Build the gate by adding the orchestrator that runs the transform on schedule, a quality-check transform whose name states the SQL assertion (range and baseline window), and the failure path: when the gate fails, the DAG halts and a paging destination notifies on-call.

Practice This Problem

Solve this Pipeline Design problem with real code execution. DataDriven runs your solution and grades it automatically.

Related

  • All Practice Problems
  • Mock Interview Mode
  • System Design Interview Questions
  • Data Engineering Interview Prep Guide
  • Daily Challenge
  • Data Engineering Lessons