A revenue pipeline at a payments company processes settlement events from Kafka, enriches them with
A medium Pipeline Design interview practice problem on DataDriven. Write and execute real pipeline design code with instant grading.
- Domain
- Pipeline Design
- Difficulty
- medium
Problem
A revenue pipeline at a payments company processes settlement events from Kafka, enriches them with a tax-jurisdiction API, validates schema, dedupes, and writes to a Snowflake mart finance reads daily. Every intermediate-tier pattern applies. Compose the resilient pipeline: classify each error class on the worker; wrap the tax-API call in a retry budget and a circuit breaker; add a DLQ for permanent and budget-exhausted events; choose skip-and-quarantine for malformed rows with a 1% threshold; route credential failures to a paging destination so on-call rotates the credential. The Snowflake destination remains on the production read path.
Practice This Problem
Solve this Pipeline Design problem with real code execution. DataDriven runs your solution and grades it automatically.