DataDriven
LearnPracticeInterviewDiscussDailyJobs

A daily revenue pipeline runs from a cron entry on a developer's laptop: bash dumps a CSV, scp moves

A medium Pipeline Design interview practice problem on DataDriven. Write and execute real pipeline design code with instant grading.

Domain
Pipeline Design
Difficulty
medium

Problem

A daily revenue pipeline runs from a cron entry on a developer's laptop: bash dumps a CSV, scp moves it, a Python script loads Snowflake, then emails a Looker URL. When the laptop sleeps the pipeline silently fails; SSH timeouts overwrite the previous good CSV; there are no retries or dependency tracking. Apply the section's DAG framing and convert this to a real orchestrated pipeline.

Practice This Problem

Solve this Pipeline Design problem with real code execution. DataDriven runs your solution and grades it automatically.

Related

  • All Practice Problems
  • Mock Interview Mode
  • System Design Interview Questions
  • Data Engineering Interview Prep Guide
  • Daily Challenge
  • Data Engineering Lessons