Tag See all →

#gunicorn

2 stories

Performance & Scaling Bug Report

huggingface/tokenizers: the current process just got forked warning in Gunicorn

Ryan Pham · Nov 14, 2024 · 6 min read

Our embedding API logged a tokenizers fork warning thousands of times a day and tokenisation got slower after we enabled Gunicorn preload. The tokenizer was used in the master process before workers forked. Loading it after fork fixed both.

Banner: one Python list shared by many function calls, leaking items between unrelated requests

Programming Languages Bug Report

Python mutable default argument leaked checkout warnings between customers

Daniel Tran · Oct 29, 2024 · 9 min read

Customers started seeing checkout warnings that belonged to other people's orders. The cause was a list used as a default argument, created once per worker process and appended to on every request. Here is how we traced it and made it impossible to reintroduce.