Idempotency

Concepts: paIdempotency

What They Want to Hear 'An idempotent pipeline produces the same result whether it runs once or ten times on the same input. I achieve this by using MERGE/UPSERT for row-level updates or partition REPLACE for partition-level writes. This makes retries, backfills, and re-runs safe. It is the single most important property of a production pipeline.' That is the answer. Same result on re-run. MERGE or REPLACE. Safety for operations.