Loading...
S3-Based Data Warehouse with File-Level Access Control
A hard Pipeline Design interview practice problem on DataDriven. Write and execute real pipeline design code with instant grading.
- Domain
- Pipeline Design
- Difficulty
- hard
- Seniority
- staff
Problem
We store all our data in S3 and want to build a warehouse on top of it. The challenge is that different teams have strict data access requirements: some data is confidential and can only be queried by specific groups, and we need that access control enforced at the file level in S3, not just at the query layer. Design the warehouse architecture.
Practice This Problem
Solve this Pipeline Design problem with real code execution. DataDriven runs your solution and grades it instantly.