A logistics ETL processes shipment events from Kafka, enriches each with a third-party route API, an
A medium Pipeline Design mock interview question on DataDriven. Practice with AI-powered feedback, real code execution, and a hire/no-hire decision.
- Domain
- Pipeline Design
- Difficulty
- medium
Interview Prompt
A logistics ETL processes shipment events from Kafka, enriches each with a third-party route API, and writes to Snowflake. Four beginner-tier failure modes are present: errors are uncategorized, retries are unbounded with bare except, 200 workers retry on the same one-second clock, and malformed rows loop forever. Assemble the resilient pipeline. Replace the broken enrich transform with one whose name states the full retry policy (bounded attempts, capped exponential backoff, jitter, transient-only). Add three terminal destinations for validation failures, authentication failures, and poison pills. The Snowflake destination must remain on the production read path.
How This Interview Works
- Read the vague prompt (just like a real interview)
- Ask clarifying questions to the AI interviewer
- Write your pipeline design solution with real code execution
- Get instant feedback and a hire/no-hire decision