Data Engineering
Bug Report
One RabbitMQ consumer hoarded 40,000 unacked messages while the others sat idle
We scaled an image processing consumer from one to eight instances and the backlog barely moved. The first consumer had taken almost every message in the queue into its own buffer. Unlimited prefetch, early acks and how basic.qos and manual acknowledgements fixed the distribution.