A curated payments table is plain Parquet

A medium Pipeline Design interview practice problem on DataDriven. Write and execute real pipeline design code with instant grading.

Domain

Pipeline Design

Difficulty

medium

Problem

A curated payments table is plain Parquet. Stripe adds new fields monthly; each schema change forces a 12-hour rewrite of every partition because plain Parquet embeds column names in the file footer. Apply the section's schema-evolution framing and replace the plain Parquet table with a lakehouse format whose metadata layer makes column additions, drops, and type widenings a sub-second metadata commit.

Practice This Problem

Solve this Pipeline Design problem with real code execution. DataDriven runs your solution and grades it automatically.