A daily clickstream lands as one giant Parquet file in S3
A medium Pipeline Design interview practice problem on DataDriven. Write and execute real pipeline design code with instant grading.
- Domain
- Pipeline Design
- Difficulty
- medium
Problem
A daily clickstream lands as one giant Parquet file in S3. Analysts only ever query a single day at a time but every query scans the whole table. Lay out the storage so a one-day query reads one day of data.
Practice This Problem
Solve this Pipeline Design problem with real code execution. DataDriven runs your solution and grades it automatically.