The Provider That Sometimes Sleeps

A medium Pipeline Design interview practice problem on DataDriven. Write and execute real pipeline design code with instant grading.

Domain

Pipeline Design

Difficulty

medium

Seniority

L5

Problem

Our quantitative research team runs pre-market models each morning on the prior day's price and volume data, pulled daily from a paid external provider whose manual pull process has already cost us missed trading sessions. The provider bills per request and goes dark for hours at a time, and our licensing terms require every raw file we receive to be kept unchanged for audit. Design an automated ingestion pipeline that lands the data on time, keeps every raw file for audit, rides out the provider's outages without draining the paid request budget, and gets a failed or late pull in front of the team before the quants hit it at model-run time.

Summary

The models run at dawn. The data has to be there first.

Practice This Problem

Solve this Pipeline Design problem with real code execution. DataDriven runs your solution and grades it automatically.