Right-Sizing Clusters

Concepts: paCostOptimization

What They Want to Hear 'I right-size by measuring utilization first. If CPU utilization averages 30% on a $80K/month cluster, I am paying for 70% idle capacity. Three strategies: (1) Auto-scaling: scale executors based on workload, not peak capacity. (2) Spot instances for batch: 60-70% discount with checkpointing for fault tolerance. (3) Reserved instances for baseline: commit to the minimum always-needed capacity at 30-50% discount, scale above that with on-demand or spot.' This is the answer that shows you optimize from data, not from guessing.