An hourly Spark job writes into a daily-partitioned plain Snowflake table with INSERT INTO
A medium Pipeline Design mock interview question on DataDriven. Practice with AI-powered feedback, real code execution, and a hire/no-hire decision.
- Domain
- Pipeline Design
- Difficulty
- medium
Interview Prompt
An hourly Spark job writes into a daily-partitioned plain Snowflake table with INSERT INTO. The section just named this exact mismatch: when run cadence is finer than partition grain, each retry appends on top and a partial-failure retry obliterates the day's accumulated work. Apply both halves of the section's recipe: an ACID destination and an idempotent intermediate step so the chain is safe end to end.
How This Interview Works
- Read the vague prompt (just like a real interview)
- Ask clarifying questions to the AI interviewer
- Write your pipeline design solution with real code execution
- Get instant feedback and a hire/no-hire decision