4 ms·

options if im not using langchain?

• ricktdotorg 2y ago
  Cloudflare AI gateway [0] [0] https://developers.cloudflare.com/ai-gateway/configuration/caching/ https://developers.cloudflare.com/ai-gateway/configuration/c...
  • spruce_tips 2y ago
    options if im not using cloudflare?
    • throwaway888abc 2y ago
      You can do it easily with object caching / function memorization patterns in any modern language which should fit your desired solution. Best of luck!
    • retrovrv 2y ago
      there's an open source ai gateway - https://github.com/Portkey-AI/gateway https://github.com/Portkey-AI/gateway