3 ms·
GPT-4 in ChatGPT has changed so much and so frequently. I've spent an inordinate time using both, side by side, and it has mostly failed to replicate the perfor
by dereg 3y ago
GPT-4 in ChatGPT has changed so much and so frequently. I've spent an inordinate time using both, side by side, and it has mostly failed to replicate the performance of their API offerings. While I don't have examples on hand right now, you can also look for yourself. Just look at the network requests in the web inspector. Here's the description of the Default ChatGPT GPT-4 model:
{
"slug": "gpt-4",
"max_tokens": 4095,
"title": "GPT-4",
"description": "Our most capable model, great for tasks that require creativity and advanced reasoning.",
"tags": [
"gpt4"
],
"capabilities": {},
"product_features": {}
}
Note the context size is 4095. Their model has been heavily optimized for speed and, presumably, cost.
- whimsicalism 3y agoI do not see what that description shows. From the OAI API, gpt-4 seems to be an alias for the most recent model two weeks after it is released. There has not been a release since 0613. https://platform.openai.com/docs/models/gpt-4 https://platform.openai.com/docs/models/gpt-4 e: from your edit, "Note the context size is 4095. Their model has been heavily optimized for speed and, presumably, cost." No, they are restricting context size to make inference on the chat interface cheaper but that does not mean it is a different model.
- dereg 3y agoKeep in mind that the information in the link you provided only applies to the developer models, which are only accessible via API and OpenAI Playground. OpenAI's developer relations person confirmed it a little whiles back: > [..] I made the comment elsewhere, but the models are always changing in ChatGPT. https://twitter.com/OfficialLoganK/status/1664477070263570432 https://twitter.com/OfficialLoganK/status/166447707026357043...
- tarvaina 3y agoI would guess max_tokens refers to the number of generated tokens, not the size of the context window. That at least is the meaning of max_tokens in the ChatGPT API. https://platform.openai.com/docs/api-reference/chat/create#chat/create-max_tokens https://platform.openai.com/docs/api-reference/chat/create#c...