A curated lake table is plain Parquet in object storage with two concurrent Spark writers committing
A medium Pipeline Design mock interview question on DataDriven. Practice with AI-powered feedback, real code execution, and a hire/no-hire decision.
- Domain
- Pipeline Design
- Difficulty
- medium
Interview Prompt
A curated lake table is plain Parquet in object storage with two concurrent Spark writers committing into overlapping partitions. Readers see partial writes, last-writer-wins corrupts the table, and there is no rollback. Apply the section's lakehouse framing and replace the plain Parquet table with an open table format that adds the metadata layer; the data files stay Parquet, only the metadata changes.
How This Interview Works
- Read the vague prompt (just like a real interview)
- Ask clarifying questions to the AI interviewer
- Write your pipeline design solution with real code execution
- Get instant feedback and a hire/no-hire decision