2 ms·

How do humans write if not by intuiting what word comes after another? Intelligence is the ability of that next word decision procedure to determine a next wor

How do humans write if not by intuiting what word comes after another? Intelligence is the ability of that next word decision procedure to determine a next word that is aligned with our human intuition and model of truth. I believe what you’re getting at is modality, that GPT-4 only provides responses in text. You can’t ask it to drive a car, or paint like Dall-e. And that’s a fair criticism, but it’s mostly just because it would make the models too large and slow, not because we don’t know how to do it. The thing we don’t know how to do is make a model reason as well as a human, and it makes sense to try to solve that in the text domain first rather than making highly multimodal models that reason poorly in all domains.

PaulDavisThe1st 3y ago
> How do humans write if not by intuiting what word comes after another? We don't know. It may turn out that we use mechanisms similar to LLMs, or it might be something entirely different. As for the rest: nobody knows how to make ChatGPT butter a piece of toast, let alone drive a car. ChatGPT does not reason about text, either.
- famouswaffles 3y ago
  >nobody knows how to make ChatGPT butter a piece of toast There is plenty of research on LLMs successfully piloting robots. It's but no means a solved problem but "Nobody knows how" is a stretch. https://tidybot.cs.princeton.edu/ https://tidybot.cs.princeton.edu/ https://innermonologue.github.io/ https://innermonologue.github.io/ >ChatGPT does not reason about text, either. It does and there's plenty of output to demonstrate that.
- famouswaffles 3y ago
  Another example https://www.deepmind.com/blog/rt-2-new-model-translates-vision-and-language-into-action https://www.deepmind.com/blog/rt-2-new-model-translates-visi...