AI & Machine Learning
Bug Report
Anthropic prompt caching never hits: cache_read_input_tokens always 0
We added cache_control to a 6,000-token system prompt and the bill went up instead of down. Every request wrote the cache and none read it, because the prompt prefix changed on every call. A stable prefix brought cache reads to 92 percent.