Cloud & Infrastructure
Bug Report
GPU pods stuck Pending: 0/3 nodes are available: Insufficient nvidia.com/gpu
We added a new GPU node pool and training pods stayed Pending with Insufficient nvidia.com/gpu, while the nodes sat idle. The NVIDIA device plugin was not running on the new nodes because its DaemonSet did not tolerate their taint, so the nodes never advertised GPUs.