Every Format Imaginable
A hard Pipeline Design mock interview question on DataDriven, with an AI interviewer who asks follow-up questions and a hire or no-hire decision at the end.
- Domain
- Pipeline Design
- Difficulty
- hard
- Seniority
- L5
Interview Prompt
Patient records arrive in four formats, all carrying PHI: structured insurance claims, semi-structured HL7 hospital messages at about 2 million a day, PDF lab reports at about 200,000 a day, and free-text clinical notes. The originals must be kept unchanged for audit and re-parsing. Design the data lake pipeline.
Summary
PDFs, HL7, JSON. All of it lands in the same lake.
How This Interview Works
- Read the vague prompt (just like a real interview)
- Ask clarifying questions to the AI interviewer
- Draw your pipeline on the design canvas: sources, transforms, storage and checks
- Answer the interviewer's follow-up questions, then get a hire or no-hire decision