2 ms·
That’s not what prompt caching is. Also, most ChatGPT users have their “personalization” prefix in the system prompt (which contains things like date/time), wh
by vineyardmike 1y ago
That’s not what prompt caching is.
Also, most ChatGPT users have their “personalization” prefix in the system prompt (which contains things like date/time), which would break caching of the actual user-query.