3 ms·

Use The Cache Luke... Langchaing exemples: [1] Caching https://python.langchain.com/v0.1/docs/modules/model_io/llms/llm_caching/ https://python.langchain.com/

Use The Cache Luke... Langchaing exemples: [1] Caching https://python.langchain.com/v0.1/docs/modules/model_io/llms/llm_caching/ https://python.langchain.com/v0.1/docs/modules/model_io/llms... [2] Fake LLM https://js.langchain.com/v0.1/docs/integrations/llms/fake/ https://js.langchain.com/v0.1/docs/integrations/llms/fake/

spruce_tips 2y ago
options if im not using langchain?
- ricktdotorg 2y ago
  Cloudflare AI gateway [0] [0] https://developers.cloudflare.com/ai-gateway/configuration/caching/ https://developers.cloudflare.com/ai-gateway/configuration/c...
  - spruce_tips 2y ago
    options if im not using cloudflare?
    - throwaway888abc 2y ago
      You can do it easily with object caching / function memorization patterns in any modern language which should fit your desired solution. Best of luck!
    - retrovrv 2y ago
      there's an open source ai gateway - https://github.com/Portkey-AI/gateway https://github.com/Portkey-AI/gateway