AI & Machine Learning
Bug Report
Fine-tuned LoRA adapter produces garbage in production: loaded on the wrong base model revision
Our LoRA adapter for ticket summarisation worked in evaluation and produced repetitive nonsense in production. Serving loaded the base model by name without a revision, and the hub repository had been updated with a new tokenizer and weights. Pinning base revisions and a load-time smoke test fixed it.