3 ms·

I’m building an app with OpenAI, using structured outputs. Does OpenAI also support prompt caching?

• minimaxir 2y ago
  Not currently.
• cma 2y ago
  I'm sure internally they use it for the system prompt at least, probably since launch. And maybe for common initial user queries that exactly match.
  • Onavo 2y ago
    They are certainly not passing the savings on to the users.
    • minimaxir 2y ago
      Yet. I suspect OpenAI will release a similar offering soon. (hooray, free market competition!)
    • HeatrayEnjoyer 2y ago
      That $100 billion data center has to get paid for somehow.