# A logistics ETL processes shipment events from Kafka, enriches each with a third-party route API, an Canonical URL: Domain: Pipeline Design ยท Difficulty: medium ## Problem A logistics ETL processes shipment events from Kafka, enriches each with a third-party route API, and writes to Snowflake. Four beginner-tier failure modes are present: errors are uncategorized, retries are unbounded with bare except, 200 workers retry on the same one-second clock, and malformed rows loop forever. Assemble the resilient pipeline. Replace the broken enrich transform with one whose name states the full retry policy (bounded attempts, capped exponential backoff, jitter, transient-only). Add three terminal destinations for validation failures, authentication failures, and poison pills. The Snowflake destination must remain on the production read path. ## Related - [All practice problems](https://datadriven.io/problems) - [Mock interview mode](https://datadriven.io/interview/a-logistics-etl-processes-shipment-events-from-kafka-enrich-ee06353f) - [System Design Interview Questions](https://datadriven.io/data-engineering-system-design) - [Data Engineering Interview Prep Guide](https://datadriven.io/data-engineer-interview-prep) - [Daily Challenge](https://datadriven.io/daily) --- Source: DataDriven (https://datadriven.io). 100% free data engineering interview prep. Live code execution against Postgres 16, Python 3.11, and Spark sandboxes. No paywall, no premium tier, no signup gate.