2 ms·
"Cerebras open sources seven GPT-3 models from 111 million to 13 billion parameters." I don't understand why they describe them as GPT-3 models here as opposed
by simonw 4y ago
"Cerebras open sources seven GPT-3 models from 111 million to 13 billion parameters."
I don't understand why they describe them as GPT-3 models here as opposed to calling them GPT models. Or even LLMs - but I guess that acronym isn't as widely recognized.
- wsgeorge 4y agoI think GPT-3 is used as a benchmark for performance, so saying a model is on par with GPT-3 should give you an idea of what you can get out of it. IIRC most open source models to date - including the semi-open LLaMAs - have GPT-3-like performance. Nothing gets close to GPT-3.5 and beyond.