DataDriven
LearnPracticeInterviewDiscussDailyJobs

A meal-kit subscription company has two raw inputs: a Postgres orders database where rows accumulate

A medium Pipeline Design interview practice problem on DataDriven. Write and execute real pipeline design code with instant grading.

Domain
Pipeline Design
Difficulty
medium

Problem

A meal-kit subscription company has two raw inputs: a Postgres orders database where rows accumulate all day until a job processes the chunk, and a Kafka topic of mobile-app clickstream events where each event flows through as it arrives. Apply the two-rhythms framing this section just taught and name each source's rhythm by setting its slaFreshness label. The Postgres source travels in scheduled chunks (a daily-tier batch label like < 24h), and the Kafka source travels continuously (a real-time-tier label like real-time or < 1min). The two sources must end up with distinct labels so the diagram does not collapse the two rhythms onto one cadence.

Practice This Problem

Solve this Pipeline Design problem with real code execution. DataDriven runs your solution and grades it automatically.

Related

  • All Practice Problems
  • Mock Interview Mode
  • System Design Interview Questions
  • Data Engineering Interview Prep Guide
  • Daily Challenge
  • Data Engineering Lessons