The Vendor Who Never Warns You

A medium Pipeline Design interview practice problem on DataDriven. Write and execute real pipeline design code with instant grading.

Domain

Pipeline Design

Difficulty

medium

Seniority

L5

Problem

We receive monthly data files from an external vendor. The problem is that the file structure changes unpredictably; new columns appear, column names get renamed, and occasionally columns are dropped. The data feeds a set of analyst dashboards that must not break when the file format changes. Design the ingestion pipeline.

Summary

Every month, something is different. The dashboards have no idea.

Practice This Problem

Solve this Pipeline Design problem with real code execution. DataDriven runs your solution and grades it automatically.