3 ms·
Yeah, it's surprising that OpenAI don't put what model it is in the system prompt. I guess the cost would add up, unless they can reuse the kv cache from the sy
by sebzim4500 3y ago
Yeah, it's surprising that OpenAI don't put what model it is in the system prompt. I guess the cost would add up, unless they can reuse the kv cache from the system prompt?