Loading...
Streaming Pipeline with Schema Validation and Snowflake Sink
A medium Pipeline Design interview practice problem on DataDriven. Write and execute real pipeline design code with instant grading.
- Domain
- Pipeline Design
- Difficulty
- medium
- Seniority
- staff
Problem
Our application generates a high volume of events that need to land in Snowflake for analytics. We've had quality issues in the past where bad data made it into production tables and broke dashboards. The platform team wants a streaming pipeline where data quality is enforced before anything reaches production. Design the pipeline.
Practice This Problem
Solve this Pipeline Design problem with real code execution. DataDriven runs your solution and grades it instantly.