AWS Pipeline with Auto-Scaling and Cost Governance

A hard Pipeline Design mock interview question on DataDriven. Practice with AI-powered feedback, real code execution, and a hire/no-hire decision.

Domain

Pipeline Design

Difficulty

hard

Seniority

staff

Interview Prompt

Our platform's data volumes are unpredictable - we see 5x swings between our quietest and busiest hours, with sudden spikes during product launches. We've been running a fixed-size Spark cluster that's over-provisioned 80% of the time and still falls behind during spikes. Design a data pipeline on AWS that handles variable volume efficiently, auto-scales without intervention, and keeps costs predictable.

How This Interview Works

1. Read the vague prompt (just like a real interview)
2. Ask clarifying questions to the AI interviewer
3. Write your pipeline design solution with real code execution
4. Get instant feedback and a hire/no-hire decision