The Identity Problem
A hard Pipeline Design mock interview question on DataDriven, with an AI interviewer who asks follow-up questions and a hire or no-hire decision at the end.
- Domain
- Pipeline Design
- Difficulty
- hard
- Seniority
- L7
Interview Prompt
How would you replace a 15-year-old Informatica job that builds the customer dimension with full change history and takes 8 hours on a 10M-row table? The data platform team wants the replacement in PySpark on Databricks.
Summary
Old systems. New demands. The same customer appears under three different names.
How This Interview Works
- Read the vague prompt (just like a real interview)
- Ask clarifying questions to the AI interviewer
- Draw your pipeline on the design canvas: sources, transforms, storage and checks
- Answer the interviewer's follow-up questions, then get a hire or no-hire decision