Tag See all →

#memory

2 stories

Performance & Scaling Bug Report

Ray OutOfMemoryError: Task was killed due to the node running low on memory

Ryan Pham · Oct 29, 2025 · 6 min read

Our Ray preprocessing job for image embeddings failed after an hour with OutOfMemoryError. Ray schedules tasks by CPU count, so it packed 16 tasks that each needed 3 GB onto nodes with 30 GB. Declaring memory per task, smaller blocks and a right-sized object store fixed it.

Banner: a Kubernetes pod whose Node.js heap grows past the container memory limit and is killed

Cloud & Infrastructure Bug Report

Kubernetes CrashLoopBackOff with OOMKilled exit code 137: Node heap set above the container limit

Daniel Tran · Dec 12, 2024 · 9 min read

Our storefront BFF pods restarted every few hours with OOMKilled and exit code 137, then fell into CrashLoopBackOff during the holiday peak. A max-old-space-size inherited from the VM days was double the container memory limit. Sizing the heap to the limit and bounding a cache fixed it.