Every Format Imaginable
A hard Pipeline Design mock interview question on DataDriven. Practice with AI-powered feedback, real code execution, and a hire/no-hire decision.
- Domain
- Pipeline Design
- Difficulty
- hard
- Seniority
- L5
Interview Prompt
We run a health data platform that aggregates patient records from hospitals, clinics, and labs, and they arrive in every format imaginable: structured insurance claims, semi-structured HL7 hospital messages, PDF lab reports, and free-text clinical notes. Analysts need to query all of it as one canonical patient-event shape, but the raw records carry PHI, so population-health researchers must work from a de-identified view while only the clinical team can reach the raw identifiers. Hospital events feed clinical decision support and must reach it within minutes on their own low-latency serving path, separate from the shared analytical store where claims, lab PDFs, and notes can be up to a day stale. Design the data lake pipeline.
Summary
PDFs, HL7, JSON. All of it lands in the same lake.
How This Interview Works
- Read the vague prompt (just like a real interview)
- Ask clarifying questions to the AI interviewer
- Write your pipeline design solution with real code execution
- Get instant feedback and a hire/no-hire decision