The Morning File

A medium Pipeline Design interview practice problem on DataDriven. Write and execute real pipeline design code with instant grading.

Domain

Pipeline Design

Difficulty

medium

Seniority

mid

Problem

A live-shopping marketplace drops a single JSON export of the previous day's orders into cloud storage every morning, roughly 4 GB and 20 million records, and analysts need it queryable in the warehouse before the daily standup. The file sometimes arrives late, occasionally gets re-delivered under the same name, and its schema shifts as product teams add fields, so a plain daily reload either double-counts orders or breaks on the new keys. Design the pipeline that lands this file in the warehouse reliably each day.

Practice This Problem

Solve this Pipeline Design problem with real code execution. DataDriven runs your solution and grades it automatically.