2 ms·
Correct, in that models know nothing about themselves other than what they are told. Deepseek R1 will tell you that it's created by OpenAI. GPT-4o mini is supp
by jychang 1y ago
Correct, in that models know nothing about themselves other than what they are told. Deepseek R1 will tell you that it's created by OpenAI.
GPT-4o mini is supposed to be ~8b params from estimates.
- simonw 1y agoThe best source I've seen for the 8B number is this TechCrunch article: https://techcrunch.com/2024/07/18/openai-unveils-gpt-4o-mini-a-small-ai-model-powering-chatgpt/ https://techcrunch.com/2024/07/18/openai-unveils-gpt-4o-mini... > OpenAI would not disclose exactly how large GPT-4o mini is, but said it’s roughly in the same tier as other small AI models, such as Llama 3 8b, Claude Haiku and Gemini 1.5 Flash. As far as I can tell all of the 8B rumors were seeded by that loosely sourced comparison to Llama 3 8B. I know for a fact that Gemini 1.5 Flash is NOT an 8B model, because a separate model called "Gemini 1.5 Flash 8B" came out after that article was published - the first Gemini model with a documented parameter count. Flash 8B is priced at half the cost of regular Flash. There's also this paper that mentions 8B but provides no source for that at all, which makes me suspect their initial source may have been that TechCrunch rumor: https://arxiv.org/pdf/2412.19260 https://arxiv.org/pdf/2412.19260
- jychang 1y ago8b params is a reasonable estimate. As a sanity check, we can look at scores for how it performs. On livebench, GPT-4o-mini scores 37.63, right next to Gemini 1.5 Flash 8B at 34.37, and above Qwen2.5 7B Instruct Turbo/Gemma 3 4B at 29.22/30.13. And it's below Phi-4 14b at 40.68, and Gemma 3 12B at 41.25.