2 ms·
Can you say more about the semantic caching, I can't seem to find much in the docs. edit: Found the cache notebook[1] and the calls to the cache and distance e
by danielbln 3y ago
Can you say more about the semantic caching, I can't seem to find much in the docs.
edit: Found the cache notebook[1] and the calls to the cache and distance eval in the code[2]
[1] https://github.com/BerriAI/litellm/blob/main/cookbook/liteLLM_ChromaDB_Cache.ipynb https://github.com/BerriAI/litellm/blob/main/cookbook/liteLL...
[2] https://github.com/BerriAI/litellm/blob/80d77fed7123af22201158528feadb83ab9a95bc/cookbook/proxy-server/main.py#L124 https://github.com/BerriAI/litellm/blob/80d77fed7123af222011...