3 ms·Cutting LLM inference costs by 36% with prompt caching2 points by lizakatz 3mo agoTokenLat 3mo ago[flagged]