4 ms·
Has there been any official confirmation of the number of parameters used in gpt4? Pages around the web seem to have conflicting reports on the number, ranging
by jjcm 3y ago
Has there been any official confirmation of the number of parameters used in gpt4? Pages around the web seem to have conflicting reports on the number, ranging from 1T to 170T, but there doesn't seem to be anything official.
- mchusma 3y agoJust to expand your lower bar, some people suspect it is not much bigger than GPT 3.5 @ 175B parameters, but this is also speculation. I don't think there has been anything official.
- rileyphone 3y agoGiven how PALM2 had less params than the first one (540B) I think that makes sense.
- euclaise 3y agoCan't be less though, the latency difference between them implies that GPT-4 is significantly larger. This is unlike with PaLM, where latency decreased.
- macrolocal 3y ago1.4T according to Michael Douglas [1]. [1] https://youtu.be/B3Az2EONCHE https://youtu.be/B3Az2EONCHE
- belter 3y agoThat is correct. The open science made at OpenAI managed to publish a 100 page GPT4 technical report without using the word parameters one single time :-) ( I checked ).