3 ms·
> ... the target size for the new model is 1 trillion parameters. > Meanwhile, the target size for the free & public versions of ChatGPT is just 175 million in
by justinclift 3y ago
> ... the target size for the new model is 1 trillion parameters.
> Meanwhile, the target size for the free & public versions of ChatGPT is just 175 million in comparison. That's a 5.7x increase in number of the parameters.
5.7x seems off by several orders of magnitude, or do I need more caffeine?
- mediaman 3y agoIt's a typo in the article. GPT-3.5 is 175bn parameters, not 175 million. GPT-4 does not have publicly available parameter count, but is thought to have something similar to 1tn.
- justinclift 3y agoCool, thanks. :)