3 ms·

This is, craaaaaazzzzzy. I'm just a layman, but to me, this is the most compelling evidence that things are starting to tilt toward AGI that I've ever seen.

triyambakam 2y ago
It's an illusion. This is just inference running.
- EGreg 2y ago
  What if the society around you is an illusion too ?
  - TeMPOraL 2y ago
    Economy definitely is, for example.
    - baq 2y ago
      Asking people ‘Is money real?’ is so much fun on parties. Bonus points for ‘what does <real> mean?’ as a follow up.
nickserv 2y ago
Nah, it's the equivalent of seeing faces in static, or animals in clouds. Our brains are hardwired to see patterns, even when there are none. A similar, and related, behavior is seeing intent and intelligence in random phenomenon.
- jimbokun 2y ago
  So it's behaving like our brains. Yet it's not AGI. Does that mean our brains do not implement General Intelligence?
  - sfink 2y ago
    When I take a dump, I do it exactly like a violin virtuoso does. I am not a violin virtuoso. Trust me, I'm really not.
    - ryandvm 2y ago
      Absolutely bonkers analogy. Ironically, I have no doubt that GPT4 could come up with a better one. What does that mean?
- GaggiX 2y ago
  This is clearly not random. If I ask to implement a particular function in Rust using a library I've previously built, and it does that, that's not random.
- jumping_frog 2y ago
  Consciousness is a suitcase term. Once all the clothes that define consciousness are neatly arranged and packed into AI then it will be conscious too.
steego 2y ago
Why are you surprised by LLMs doing irrational or weird things? All machine learning models start off in a random state. As they progress through their training, their input/output pairs tend to mimic what they've been trained to mimic. LLMs have been doing a great job mimicking our human flaws from the beginning because we train them on a ton of human generated data. Other weird behavior can be easily attributed to simple fact that they're initialized at a random state. Being able to work on and prove non-trivial theorems is a better indication of AGI, IMO.
teaearlgraycold 2y ago
You’re anthropomorphizing it. Years ago people were trying to argue that when GPT-3.0 would repeat words in a loop it was being poetic. No, it’s just a statistical failure mode. When these new models go off to a random site and are caught in a loop of exploring pages that doesn’t mean it’s an AGI admiring nature.

triyambakam 2y ago

It's an illusion. This is just inference running.

EGreg 2y ago
What if the society around you is an illusion too ?
- TeMPOraL 2y ago
  Economy definitely is, for example.
  - baq 2y ago
    Asking people ‘Is money real?’ is so much fun on parties. Bonus points for ‘what does <real> mean?’ as a follow up.

nickserv 2y ago

Nah, it's the equivalent of seeing faces in static, or animals in clouds. Our brains are hardwired to see patterns, even when there are none. A similar, and related, behavior is seeing intent and intelligence in random phenomenon.

jimbokun 2y ago
So it's behaving like our brains. Yet it's not AGI. Does that mean our brains do not implement General Intelligence?
- sfink 2y ago
  When I take a dump, I do it exactly like a violin virtuoso does. I am not a violin virtuoso. Trust me, I'm really not.
  - ryandvm 2y ago
    Absolutely bonkers analogy. Ironically, I have no doubt that GPT4 could come up with a better one. What does that mean?
GaggiX 2y ago
This is clearly not random. If I ask to implement a particular function in Rust using a library I've previously built, and it does that, that's not random.
jumping_frog 2y ago
Consciousness is a suitcase term. Once all the clothes that define consciousness are neatly arranged and packed into AI then it will be conscious too.

steego 2y ago

Why are you surprised by LLMs doing irrational or weird things? All machine learning models start off in a random state. As they progress through their training, their input/output pairs tend to mimic what they've been trained to mimic. LLMs have been doing a great job mimicking our human flaws from the beginning because we train them on a ton of human generated data. Other weird behavior can be easily attributed to simple fact that they're initialized at a random state. Being able to work on and prove non-trivial theorems is a better indication of AGI, IMO.

teaearlgraycold 2y ago

You’re anthropomorphizing it. Years ago people were trying to argue that when GPT-3.0 would repeat words in a loop it was being poetic. No, it’s just a statistical failure mode. When these new models go off to a random site and are caught in a loop of exploring pages that doesn’t mean it’s an AGI admiring nature.