File Ingestion

Concepts: paFileIngestion

What They Want to Hear 'Files are the most common ingestion method. A vendor drops a CSV on S3, an event notification triggers the pipeline, and we validate before ingesting.' That is the baseline answer. Then show depth by naming formats and their tradeoffs: CSV is universal but slow at scale. Parquet is columnar, compressed, and 10-30x faster for analytics. JSON is flexible but verbose. Format Cheat Sheet