# A revenue pipeline at a payments company processes settlement events from Kafka, enriches them with

Canonical URL: <https://datadriven.io/problems/a-revenue-pipeline-at-a-payments-company-processes-settlemen-013dede8>

Domain: Pipeline Design · Difficulty: medium

## Problem

A revenue pipeline at a payments company processes settlement events from Kafka, enriches them with a tax-jurisdiction API, validates schema, dedupes, and writes to a Snowflake mart finance reads daily. Every intermediate-tier pattern applies. Compose the resilient pipeline: classify each error class on the worker; wrap the tax-API call in a retry budget and a circuit breaker; add a DLQ for permanent and budget-exhausted events; choose skip-and-quarantine for malformed rows with a 1% threshold; route credential failures to a paging destination so on-call rotates the credential. The Snowflake destination remains on the production read path.

## Related

- [All practice problems](https://datadriven.io/problems)
- [Mock interview mode](https://datadriven.io/interview/a-revenue-pipeline-at-a-payments-company-processes-settlemen-013dede8)
- [System Design Interview Questions](https://datadriven.io/data-engineering-system-design)
- [Data Engineering Interview Prep Guide](https://datadriven.io/data-engineer-interview-prep)
- [Daily Challenge](https://datadriven.io/daily)

---

Source: DataDriven (https://datadriven.io). 100% free data engineering interview prep. Live code execution against Postgres 16, Python 3.11, and Spark sandboxes. No paywall, no premium tier, no signup gate.