4 ms·

> but do not have even a theory about how the behavior emerges We fully do. There is a significant quality difference between English language output and othe

> but do not have even a theory about how the behavior emerges We fully do. There is a significant quality difference between English language output and other languages which lends a huge hint as to what is actually happening behind the scenes. > but how exactly does anthill behavior come from ant behavior? You can't smell what ants can. If you did I'm sure it would be evident.

kristiandupont 8mo ago
I am very curious about this significant hint, could you point me to some material?
spiralcoaster 8mo ago
Two very big revelations here that I would love to know more about: 1. Can you reveal "what's actually happening behind the scenes" beyond the hint you gave? I can't figure it out. 2. Can you explain how an ants sense of smell leads to anthills?
- jen729w 8mo ago
  > 2. Can you explain how an ants sense of smell leads to anthills? Ant 0: doesn’t seem to be dangerous here. I’ll drop a scent. Ant 1: oh cool, a safe place. And I didn’t die either. I’ll reinforce that. Ant 142,857,098,277: cool anthill.
  - fc417fc802 8mo ago
    The dynamics of ant nest creation are way more complicated than that. The evolved biological parallel of a procedural generation algorithm. In addition, the completed structure has to be compatible with the various programmed behaviors of the workers.
canjobear 8mo ago
> There is a significant quality difference between English language output and other languages ?
- floren 8mo ago
  They're saying LLMs do better when outputting English than other languages, an assertion I'm not really able to test but have heard elsewhere.
  - bryanrasmussen 8mo ago
    and this is somehow not related to the size and availability of corpora in English?
    - floren 8mo ago
      No, I'm quite sure that's why it's better.
      - bryanrasmussen 8mo ago
        OK but then that goes back to their other assertion that it gives a huge hint at what is going on behind the scenes, is that huge hint just "more data gives better results!" if so, that doesn't seem at all important since that is the absolutely central idea of an LLM. That is not behind the scenes at all, that is the introduction to the play as written by the author. Not your fault obviously, but they have not yet described what that huge hint is, and I'm just at the edge of my seat with anticipation here.

kristiandupont 8mo ago

I am very curious about this significant hint, could you point me to some material?

spiralcoaster 8mo ago

Two very big revelations here that I would love to know more about: 1. Can you reveal "what's actually happening behind the scenes" beyond the hint you gave? I can't figure it out. 2. Can you explain how an ants sense of smell leads to anthills?

jen729w 8mo ago
> 2. Can you explain how an ants sense of smell leads to anthills? Ant 0: doesn’t seem to be dangerous here. I’ll drop a scent. Ant 1: oh cool, a safe place. And I didn’t die either. I’ll reinforce that. Ant 142,857,098,277: cool anthill.
- fc417fc802 8mo ago
  The dynamics of ant nest creation are way more complicated than that. The evolved biological parallel of a procedural generation algorithm. In addition, the completed structure has to be compatible with the various programmed behaviors of the workers.

canjobear 8mo ago

> There is a significant quality difference between English language output and other languages ?

floren 8mo ago
They're saying LLMs do better when outputting English than other languages, an assertion I'm not really able to test but have heard elsewhere.
- bryanrasmussen 8mo ago
  and this is somehow not related to the size and availability of corpora in English?
  - floren 8mo ago
    No, I'm quite sure that's why it's better.
    - bryanrasmussen 8mo ago
      OK but then that goes back to their other assertion that it gives a huge hint at what is going on behind the scenes, is that huge hint just "more data gives better results!" if so, that doesn't seem at all important since that is the absolutely central idea of an LLM. That is not behind the scenes at all, that is the introduction to the play as written by the author. Not your fault obviously, but they have not yet described what that huge hint is, and I'm just at the edge of my seat with anticipation here.