DevOps & CI/CD
Bug Report
PyTorch DataLoader: Unexpected bus error encountered in worker in Docker and Kubernetes
Training jobs that ran fine on a workstation crashed in containers with a bus error in DataLoader workers. Workers pass batches through shared memory, and containers get only 64 MB of /dev/shm by default. A memory-backed emptyDir in Kubernetes and --shm-size in Docker fixed it.