FinOps & Cloud Cost
Bug Report
Idle GPU nodes billed all weekend: why the cluster autoscaler would not scale down
Our GPU node pool stayed at eight nodes from Friday night to Monday morning with almost no GPU usage. The cluster autoscaler refused to remove them: notebook pods with local storage, a bare debug pod and a kube-system pod without a PDB. Fixing each blocker cut GPU spend by 38 percent.