2 ms·
That would make sense to me, but AFAIK the existence of text-only trained GPT-4 is not publicly reported? Or I missed this.
by whimsicalism 4y ago
That would make sense to me, but AFAIK the existence of text-only trained GPT-4 is not publicly reported? Or I missed this.
- lucubratory 4y agoIt has been, it was in the Microsoft research paper "Sparks of AGI". You can watch the lead author of the paper, Sebastien Bubeck, present it here: https://youtu.be/qbIk7-JPB2c https://youtu.be/qbIk7-JPB2c It's a good video for understanding GPT-4 as a "What are we sure that LLMs are technically capable of?" exercise. As he notes in the video right at the start, the model was made safe and thus has significantly lower performance in the public release, so the examples he shows aren't replicable in the different model the public has access to.
- whimsicalism 4y agoI see that you are probably referring to the claim at 4:30... but I'm not sure he is actually saying that the early model had no text capability or if it merely was not something they were given access to.