Loading...

Lambda Architecture for Batch and Streaming Workloads

A hard Pipeline Design interview practice problem on DataDriven. Write and execute real pipeline design code with instant grading.

Domain
Pipeline Design
Difficulty
hard
Seniority
staff

Problem

We're a data services company and our enterprise client sends us two kinds of data: a continuous stream of transactions throughout the day, and a large daily batch file that reconciles and corrects the day's activity. Both need to land in the same warehouse and both matter to the analysts. Design a pipeline that handles both paths.

Practice This Problem

Solve this Pipeline Design problem with real code execution. DataDriven runs your solution and grades it instantly.