The Whiteboard Exercise

A medium Pipeline Design interview practice problem on DataDriven. Write and execute real pipeline design code with instant feedback.

Domain

Pipeline Design

Difficulty

medium

Seniority

L5

Problem

We run an e-commerce marketplace where transactions live in a Postgres database, customer records come from a rate-limited CRM API, and a partner ships the daily product catalog as CSV files over SFTP. About 50 business analysts open a dashboard at 8am each morning to slice yesterday's transactions by customer, product, channel, and date, so all three sources have to land in the warehouse during the overnight window: the customer detail from the CRM, the product detail from the partner catalog, the transactions from Postgres. Keep the load resilient to the partner's occasional CSV column changes and the CRM API's rate limits, and design the pipeline end to end.

Summary

Marker in hand. Draw the whole thing.

Practice This Problem

Solve this Pipeline Design problem with real code execution. DataDriven runs your solution and checks it automatically.