Tag See all →

#cloudwatch

2 stories

Banner: AWS budget alert arriving long after a cloud spend spike began

Cloud & Infrastructure Bug Report

AWS Budget alert arrived two days after the spend spike started

Ryan Pham · Aug 13, 2025 · 6 min read

A misconfigured batch job launched 60 GPU instances on a Friday evening. Our monthly budget alert fired on Sunday afternoon, after 14,000 USD was spent. Monthly thresholds and billing data lag make budgets slow. We added daily budgets, anomaly detection and real-time usage guardrails.

Banner: CloudWatch Logs ingestion cost spike from debug logging and health check logs

Cloud & Infrastructure Bug Report

CloudWatch Logs bill tripled: debug logging left on and health checks logged

Ryan Pham · Nov 20, 2024 · 6 min read

Our CloudWatch line went from 2,100 to 6,900 USD in a month without new services. Debug logging enabled during an incident was never turned off, and every load balancer health check produced a log line. Finding the top log groups and fixing levels cut ingestion by 81 percent.