A Stripe REST API ingestion job paginates by stopping at the first empty response, burns its rate bu

A medium Pipeline Design interview practice problem on DataDriven. Write and execute real pipeline design code with instant grading.

Domain

Pipeline Design

Difficulty

medium

Problem

A Stripe REST API ingestion job paginates by stopping at the first empty response, burns its rate budget in the first five minutes of every run, and lets the OAuth token expire mid-pagination with no refresh. Three Stripe outages a month show up in the pipeline as silent partial loads. The section names four concerns of API ingestion: pagination (cursor-based is the strongest), rate limits (respect Retry-After), auth (refresh before expiry), and reliability (retry with backoff on 429 and 5xx). Add the rate limiter by replacing the API ingest transform with one whose name states cursor-based pagination, a rate-limiter that respects Retry-After, an OAuth refresh policy, and retry-with-backoff on 429 and 5xx.

Practice This Problem

Solve this Pipeline Design problem with real code execution. DataDriven runs your solution and grades it automatically.