Data Engineering
Bug Report
One malformed message blocked our order queue for four hours
A single order event with an unexpected null crashed the consumer, went back to the queue, and was delivered again, forever. Behind it, thousands of orders waited. How we found it, why the queue had no redrive policy, and the max receive count, DLQ and redrive process we use now.