DevOps & CI/CD
Bug Report
Two pipelines raced and the older commit was deployed last, silently reverting a fix
We merged a hotfix minutes after a feature, and production ended up running the feature without the hotfix. Two pipeline runs deployed in the wrong order because the older one had a slower test stage. How we found it, and the fixes: concurrency groups, deploying immutable digests and refusing to deploy older commits.