DataDriven
LearnPracticeInterviewDiscussDailyJobs

Three operational questions show up in a 3am incident: 'what specifically happened during last night

A medium Pipeline Design interview practice problem on DataDriven. Write and execute real pipeline design code with instant grading.

Domain
Pipeline Design
Difficulty
medium

Problem

Three operational questions show up in a 3am incident: 'what specifically happened during last night's run' (read individual events), 'is rows_written following its normal trend' (aggregate over time and alert), and 'where in the pipeline did the request slow down' (see one logical run as a path). The section names three signal classes that answer each: logs (timestamped human-readable events), metrics (low-cardinality numerics aggregated and alerted), and traces (a path tying together the operations of one run). Pick logs, metrics, or traces by adding three destinations downstream of the transform, one per signal class, each with a tech that fits its role.

Practice This Problem

Solve this Pipeline Design problem with real code execution. DataDriven runs your solution and grades it automatically.

Related

  • All Practice Problems
  • Mock Interview Mode
  • System Design Interview Questions
  • Data Engineering Interview Prep Guide
  • Daily Challenge
  • Data Engineering Lessons