3 ms·

The problem with LLMs reaching true AGI is it's basically "static" intelligence. Changing code, context, prompts and even fine tuning can improve output, but is

by cjonas 1y ago

The problem with LLMs reaching true AGI is it's basically "static" intelligence. Changing code, context, prompts and even fine tuning can improve output, but is still far from realtime learning. The "weights" in our brains are constantly evolving.

uripont 1y ago
Interesting. The reason why companies aren't trying their best yet into non-static weights/online learning is probably (cloud) logistics. It seems simpler, easier and cheaper to serve a static, well-evaluated, and tuned model, rather than trying to let it learn alongside a specific user or all users.
- cjonas 1y ago
  Oh absolutely. To be clear... I think this is probably a bad idea. It probably wouldn't be successful and if it was you'd have very little control of how it evolves.
ninetyninenine 1y ago
Have you seen memento? Humans can be intelligent while losing the ability to learn and form new memories. See here: https://my.clevelandclinic.org/health/diseases/23221-anterograde-amnesia https://my.clevelandclinic.org/health/diseases/23221-anterog... It is categorically wrong that non static learning is a requirement of agi. The biggest problem we face is hallucinations and this isn’t caused by the fact that agi can’t learn on the fly.
- mannykannot 1y ago
  I take it that you are referring to the movie Memento? I had not heard of it, but I'll put it on my watch list. I take your point about the non-necessity of dynamic learning for AGI.
- wahern 1y ago
  Doesn't Memento prove the opposite? The character was basically stuck in a loop, and was taken advantage of by someone who held the real agency. (Notwithstanding the "happy ending" conceit at the end that resolves the audience's uncomfortableness with this lack of agency by intimating he may still possess some minimal agency despite the big reveal.) But in any event, drawing conclusions about the real world from a fictional story seems fraught.
  - ninetyninenine 1y ago
    Leonard was still an intelligent entity despite lacking the ability to learn. In fact the amount of limited agency Leonard had is similar to the limits in agency we want for an agi that serves humanity. Anyway my main point is Leonard has intelligence well past what we expect from an agi. So because people like Leonard are documented to actually exist one can say live learning is not really needed to have Leonard levels ( aka agi levels) of intelligence

by cjonas 1y ago

uripont 1y ago

Interesting. The reason why companies aren't trying their best yet into non-static weights/online learning is probably (cloud) logistics. It seems simpler, easier and cheaper to serve a static, well-evaluated, and tuned model, rather than trying to let it learn alongside a specific user or all users.

cjonas 1y ago
Oh absolutely. To be clear... I think this is probably a bad idea. It probably wouldn't be successful and if it was you'd have very little control of how it evolves.

ninetyninenine 1y ago

Have you seen memento? Humans can be intelligent while losing the ability to learn and form new memories. See here: https://my.clevelandclinic.org/health/diseases/23221-anterograde-amnesia https://my.clevelandclinic.org/health/diseases/23221-anterog... It is categorically wrong that non static learning is a requirement of agi. The biggest problem we face is hallucinations and this isn’t caused by the fact that agi can’t learn on the fly.

mannykannot 1y ago
I take it that you are referring to the movie Memento? I had not heard of it, but I'll put it on my watch list. I take your point about the non-necessity of dynamic learning for AGI.
wahern 1y ago
Doesn't Memento prove the opposite? The character was basically stuck in a loop, and was taken advantage of by someone who held the real agency. (Notwithstanding the "happy ending" conceit at the end that resolves the audience's uncomfortableness with this lack of agency by intimating he may still possess some minimal agency despite the big reveal.) But in any event, drawing conclusions about the real world from a fictional story seems fraught.
- ninetyninenine 1y ago
  Leonard was still an intelligent entity despite lacking the ability to learn. In fact the amount of limited agency Leonard had is similar to the limits in agency we want for an agi that serves humanity. Anyway my main point is Leonard has intelligence well past what we expect from an agi. So because people like Leonard are documented to actually exist one can say live learning is not really needed to have Leonard levels ( aka agi levels) of intelligence