3 ms·
LLMs aren't chatbots. That's just a nice consequence of what they can do. Their prediction abilities stretch beyond just language even if they're only trained
by famouswaffles 3y ago
LLMs aren't chatbots. That's just a nice consequence of what they can do.
Their prediction abilities stretch beyond just language even if they're only trained on it.
https://general-pattern-machines.github.io/ https://general-pattern-machines.github.io/
There's nothing specialized about being able to predict meaningful completions from arbitrary token sequences.
There's a whole lot that can be done with that even if they were constrained to language.
https://tidybot.cs.princeton.edu/ https://tidybot.cs.princeton.edu/
https://innermonologue.github.io/ https://innermonologue.github.io/
There's nothing stupid about GPT-4. There's no testable definition of general intelligence GPT-4 would fail that a chunk of humans also wouldn't.
Vision understanding does not have to be a separate model. https://arxiv.org/abs/2306.14824 https://arxiv.org/abs/2306.14824