Pipeline Versioning

Concepts: paCiCd

What They Want to Hear 'Code versioning is simple: git. Data versioning is harder: you need to know what the table looked like at a specific point in time. Table formats (Iceberg, Delta) provide time travel: query the table as of a specific timestamp or version number. For reprocessing after a logic change, replay from the last known good state using Bronze data and the new code.'