3 ms·
> GPT-3 does what it says it does on the sticker. It continues text based on what it reads. The problem is that this isn't what it "says on the sticker" to the
by KhoomeiK 5y ago
> GPT-3 does what it says it does on the sticker. It continues text based on what it reads.
The problem is that this isn't what it "says on the sticker" to the vast majority of people, especially outside of academia. What we think of as a simple probabilistic language model trained on a huge corpus of English, the general public thinks of as "an artificial intelligence" that has logical reasoning capabilities etc. Using the term "foundation models for AI" intentionally seems to obscure this fact by implying a direct link between language models and AI, when in reality, an LM is nothing more than a faculty for syntactically (and vaguely semantically) acceptable language generation.