5 ms·

"Even if you just make GPT-4 say 33% smarter and 50 or 100 times faster and more efficient, that can lead to control of industrial and military assets being han

"Even if you just make GPT-4 say 33% smarter and 50 or 100 times faster and more efficient, that can lead to control of industrial and military assets being handed over to these AI agents." I call BS on this...it's an LLM...

crop_rotation 3y ago
Saying it's "an LLM" doesn't change the impact. GPT4 is an LLM, and so are many others ranging from toy quality to GPT3.5. It is very clear GPT4 is much better. If there is another jump like GPT4 , whether it is LLM or not, it's impact will be huge.
- esafak 3y ago
  Plus the next thing might not be an LLM.
- woadwarrior01 3y ago
  Meanwhile, GPT-4 still can’t reliably multiply small numbers. https://arxiv.org/abs/2304.02015 https://arxiv.org/abs/2304.02015
  - fprotthetarball 3y ago
    A minor inconvenience when GPT-4 has no problem learning how to use a code interpreter.
  - mhb 3y ago
    Do you find that comforting when an emergent property of a system whose objective is to complete the next word is able to make drawings?
    - StrictDabbler 3y ago
      Imagine you meet a human who is eloquent, expressive, speaks ten languages, can pass the bar or the medical board exams easily, but who cannot reliably distinguish between truth and falsehood on the smallest of questions ("what is 6x9? 42") and has no persistent memory or sense of self. Would you be "comforted" that this mega-genius is worse at arithmetic than you are and doesn't remember what it did yesterday? Probably not. You might well be worried that this weird psychopath is going to get a medical license and cut the wrong number of fingers off of a whole bunch of patients.
      - mhb 3y ago
        We're agreeing, aren't we?
  - famouswaffles 3y ago
    It's alright with algorithmic prompts - https://arxiv.org/abs/2211.09066 https://arxiv.org/abs/2211.09066 also it knows when to use a calculator if it has access to one so it's not a big deal
  - CamperBob2 3y ago
    "This Apple II is useless. It can't even run Crysis."
  - deleted 3y ago
    [deleted]
chaxor 3y ago
It's important to recognize that the model is fully capable of operating in open world environments, with visual stimuli and motor output, go achieve high level tasks. This has been demonstrated in proofs of concepts several times now with systems such as voyager et al. So, while there are certainly some details that are important, much of them are the annoyances that we devs deal with all the time (how to connect various parts of a system properly, etc) the fundamental capabilities of expressivity in these models are not that limited. Certainly limited in some sense (as seen in the several papers applying category theoretic arguments to transformers) but for many engineering applications in the world, these models are very capable and useful. Guarantees of correctness and safety are obviously of huge concern, hence the main article. But it's absolutely not unreasonable to see these models allowing humanoid robots capable of various day to day activities and work.
- DennisP 3y ago
  To save others the trouble, I googled Voyager, it's pretty interesting. I had no idea an LLM could do this sort of thing: https://voyager.minedojo.org/ https://voyager.minedojo.org/
  - famouswaffles 3y ago
    Other examples(in the real world) you might find interesting. https://tidybot.cs.princeton.edu/ https://tidybot.cs.princeton.edu/ https://innermonologue.github.io/ https://innermonologue.github.io/ https://palm-e.github.io/ https://palm-e.github.io/ https://www.microsoft.com/en-us/research/group/autonomous-systems-group-robotics/articles/chatgpt-for-robotics/ https://www.microsoft.com/en-us/research/group/autonomous-sy...
    - Animats 3y ago
      > https://palm-e.github.io/ https://palm-e.github.io/ The alignment problem will come up when the robot control system notices that the guy with the stick is interfering with the robot's goals.
908087 3y ago
[dead]
Footkerchief 3y ago
Military command and control is already performed via input and output of token streams.
ben_w 3y ago
It's autocomplete on steroids… That can guide me through the process of writing a Navier-Stokes simulation… In a foreign language… That can be trivially put into a loop and tasked with acting like an agent… And which is good enough that people are already seriously asking themselves if they need to hire people to do certain tasks… … Why call BS? It's not perfect, sure, but it's not making a highly regional joke about the Isle of White Ferry[0] either. [0] "What's brown and comes steaming out the back of Cowes?"
- wickoff 3y ago
  But you're also autocomplete (prediction engine) on steroids. https://www.psy.ox.ac.uk/news/the-brain-is-a-prediction-machine-it-knows-how-good-we-are-doing-something-before-we-even-try https://www.psy.ox.ac.uk/news/the-brain-is-a-prediction-mach...
  - ben_w 3y ago
    "It's one of those irregular verbs, isn't it? I'm good at improv and speaking on my feet, you finish each other's sentences, they're just autocomplete on steroids." https://en.wikiquote.org/wiki/Yes,_Minister https://en.wikiquote.org/wiki/Yes,_Minister
reaperman 3y ago
GPT-4 is actually multimodal, not just an LLM. OpenAI just doesn't provide the public with any way to use the image embedding capabilities.
nopinsight 3y ago
LLM is already a misnomer. Many of the latest models are better called LFMs (Large Foundation Models). They have multimodal capabilities. Some can even handle sensory input humans can't. Another comment already links to demos and papers of LFMs operating robots and agents in 3D environments.

crop_rotation 3y ago

Saying it's "an LLM" doesn't change the impact. GPT4 is an LLM, and so are many others ranging from toy quality to GPT3.5. It is very clear GPT4 is much better. If there is another jump like GPT4 , whether it is LLM or not, it's impact will be huge.

esafak 3y ago
Plus the next thing might not be an LLM.
woadwarrior01 3y ago
Meanwhile, GPT-4 still can’t reliably multiply small numbers. https://arxiv.org/abs/2304.02015 https://arxiv.org/abs/2304.02015
- fprotthetarball 3y ago
  A minor inconvenience when GPT-4 has no problem learning how to use a code interpreter.
- mhb 3y ago
  Do you find that comforting when an emergent property of a system whose objective is to complete the next word is able to make drawings?
  - StrictDabbler 3y ago
    Imagine you meet a human who is eloquent, expressive, speaks ten languages, can pass the bar or the medical board exams easily, but who cannot reliably distinguish between truth and falsehood on the smallest of questions ("what is 6x9? 42") and has no persistent memory or sense of self. Would you be "comforted" that this mega-genius is worse at arithmetic than you are and doesn't remember what it did yesterday? Probably not. You might well be worried that this weird psychopath is going to get a medical license and cut the wrong number of fingers off of a whole bunch of patients.
    - mhb 3y ago
      We're agreeing, aren't we?
- famouswaffles 3y ago
  It's alright with algorithmic prompts - https://arxiv.org/abs/2211.09066 https://arxiv.org/abs/2211.09066 also it knows when to use a calculator if it has access to one so it's not a big deal
- CamperBob2 3y ago
  "This Apple II is useless. It can't even run Crysis."
- deleted 3y ago
  [deleted]

chaxor 3y ago

It's important to recognize that the model is fully capable of operating in open world environments, with visual stimuli and motor output, go achieve high level tasks. This has been demonstrated in proofs of concepts several times now with systems such as voyager et al. So, while there are certainly some details that are important, much of them are the annoyances that we devs deal with all the time (how to connect various parts of a system properly, etc) the fundamental capabilities of expressivity in these models are not that limited. Certainly limited in some sense (as seen in the several papers applying category theoretic arguments to transformers) but for many engineering applications in the world, these models are very capable and useful. Guarantees of correctness and safety are obviously of huge concern, hence the main article. But it's absolutely not unreasonable to see these models allowing humanoid robots capable of various day to day activities and work.

DennisP 3y ago
To save others the trouble, I googled Voyager, it's pretty interesting. I had no idea an LLM could do this sort of thing: https://voyager.minedojo.org/ https://voyager.minedojo.org/
- famouswaffles 3y ago
  Other examples(in the real world) you might find interesting. https://tidybot.cs.princeton.edu/ https://tidybot.cs.princeton.edu/ https://innermonologue.github.io/ https://innermonologue.github.io/ https://palm-e.github.io/ https://palm-e.github.io/ https://www.microsoft.com/en-us/research/group/autonomous-systems-group-robotics/articles/chatgpt-for-robotics/ https://www.microsoft.com/en-us/research/group/autonomous-sy...
  - Animats 3y ago
    > https://palm-e.github.io/ https://palm-e.github.io/ The alignment problem will come up when the robot control system notices that the guy with the stick is interfering with the robot's goals.

908087 3y ago

[dead]

Footkerchief 3y ago

Military command and control is already performed via input and output of token streams.

ben_w 3y ago

It's autocomplete on steroids… That can guide me through the process of writing a Navier-Stokes simulation… In a foreign language… That can be trivially put into a loop and tasked with acting like an agent… And which is good enough that people are already seriously asking themselves if they need to hire people to do certain tasks… … Why call BS? It's not perfect, sure, but it's not making a highly regional joke about the Isle of White Ferry[0] either. [0] "What's brown and comes steaming out the back of Cowes?"

wickoff 3y ago
But you're also autocomplete (prediction engine) on steroids. https://www.psy.ox.ac.uk/news/the-brain-is-a-prediction-machine-it-knows-how-good-we-are-doing-something-before-we-even-try https://www.psy.ox.ac.uk/news/the-brain-is-a-prediction-mach...
- ben_w 3y ago
  "It's one of those irregular verbs, isn't it? I'm good at improv and speaking on my feet, you finish each other's sentences, they're just autocomplete on steroids." https://en.wikiquote.org/wiki/Yes,_Minister https://en.wikiquote.org/wiki/Yes,_Minister

reaperman 3y ago

GPT-4 is actually multimodal, not just an LLM. OpenAI just doesn't provide the public with any way to use the image embedding capabilities.

nopinsight 3y ago

LLM is already a misnomer. Many of the latest models are better called LFMs (Large Foundation Models). They have multimodal capabilities. Some can even handle sensory input humans can't. Another comment already links to demos and papers of LFMs operating robots and agents in 3D environments.