3 ms·
GPT-3 has been publicly covered in scientific publications. Same as GPT-2, and GPT. Those are all pre-trained models, where GPT is the abbreviation of Generativ
by de6u99er 4y ago
GPT-3 has been publicly covered in scientific publications. Same as GPT-2, and GPT. Those are all pre-trained models, where GPT is the abbreviation of Generative Pretrained Transformer. Transformers have been invented in 2017 at Google Brain [1].
-> https://medium.com/walmartglobaltech/the-journey-of-open-ai-gpt-models-32d95b7b7fb2 https://medium.com/walmartglobaltech/the-journey-of-open-ai-...
GPT-4 is around the corner, and it's allegedly 100x more powerful than it'd predecessor.
-> https://medium.com/geekculture/gpt-4-100x-more-powerful-than-gpt-3-38c57f51e4e3 https://medium.com/geekculture/gpt-4-100x-more-powerful-than...
[1] https://arxiv.org/abs/1706.03762 https://arxiv.org/abs/1706.03762
- wcoenen 4y agoThat source about GPT-4 is nonsense. It claims GPT-4 will have trillions of parameter, and at the same time links to another page which says that it won't be much bigger than GPT-3: https://www.datacamp.com/blog/what-we-know-gpt4 https://www.datacamp.com/blog/what-we-know-gpt4
- simonw 4y agoThat "100x" figure is extremely poorly sourced. I don't believe that at all.
- de6u99er 4y agoYou're right. Apologies for that.
- imtringued 4y agoAnd yet the intimidating pictures of a small and large circle keep getting posted everywhere.