4 ms·

Find it similarly amazing, yes. > This means that the Cray could run it Gladly, we had better things to do than that :D But seriously, while we could have ru

Find it similarly amazing, yes. > This means that the Cray could run it Gladly, we had better things to do than that :D But seriously, while we could have run it maybe speedwise, it definitely lacked the memory, not? And if one tried to train it he wouldn't be finished today. But would make a fun backwards sci-fi story imagining a time traveller that brought the 80ies an LLM from today, what would the world say and do with that slow oracle?

samstave 3y ago
May you please do me (and others) a favor: What value does an LLM hold intrinsically. Lets say "brought an LLM from today" Does that mean just a multi gig file? What is INSIDE the LLM that would be of value? How does one speak to an LLM WRT 80's tech, and what could one glean from it.... ELI5 an LLM; BARD: https://i.imgur.com/ahRVECz.png https://i.imgur.com/ahRVECz.png OpenAI: https://i.imgur.com/Rbk5BD6.png https://i.imgur.com/Rbk5BD6.png Bing: https://i.imgur.com/zVJ1tu6.png https://i.imgur.com/zVJ1tu6.png -- So, how would one explain 80s folks what even an LLM is when we cant even ELI5 2024?
- LeoPanthera 3y ago
  In a way that someone in the 80s could understand? An LLM is a very highly compressed store of knowledge combined with an advanced parser than understands questions in plain English. A consequence of the compression is that sometimes the answers lose some accuracy, which is a deliberate trade-off to make it work at all.
  - samstave 3y ago
    Now paint me a picture of a cat. Good LLM.
    - AlexeyBelov 3y ago
      LLMs don't paint.
  - NikkiA 3y ago
    Neural networks were known about in the 80s, they were theorised about in the 1800s ffs, and the first computer based NNs were in the 1950s.
- throwbadubadu 3y ago
  My story plot would sure include LLM (coefficients file as today) + code to run it. So 80s humans could run it on the Cray, ask it questions, and get answers (after some time :D). LLM could explain itself what it is.. (if there are not more important questions to ask, contention would ensue).
- bee_rider 3y ago
  I don’t think they’d have any trouble with the math, it’s just a bunch of regressions and matvecs, right? I think the process of collecting and storing all the data would be more mind blowing to them—of course they were at the beginning of Moore’s law, so they could see the trajectory if they looked for it, but it is one thing to stand on the coast with waves lapping at your ankles and imagine how the ocean gets deeper as you keep going and another to get chucked out of a helicopter in the middle of the Pacific.
- d0mine 3y ago
  LLM is a lossy compression of the internet. We can provide it in a form that is directly executable on 80s computers though gpt4 tries to convince me that it is practically impossible the reduced model would be much weaker (somebody doesn't want to be sent to 80s ;)
- worewood 3y ago
  Yes, that means just a multi gig file. The hard part of LLMs (and current AI in general) is training, which is orders of magnitude harder than inference. If somehow we had a way to travel to the future in the 70s, train the models and then come back, we would be in Star Trek right now
dekhn 3y ago
I can't find it now but I wrote a bit of fanfic where Ken Thompson sent an LLM back in time (referencing his "Love, Ken" UNIX tapes that he would send out) to save humanity. He was always a bit head of his time.

samstave 3y ago

May you please do me (and others) a favor: What value does an LLM hold intrinsically. Lets say "brought an LLM from today" Does that mean just a multi gig file? What is INSIDE the LLM that would be of value? How does one speak to an LLM WRT 80's tech, and what could one glean from it.... ELI5 an LLM; BARD: https://i.imgur.com/ahRVECz.png https://i.imgur.com/ahRVECz.png OpenAI: https://i.imgur.com/Rbk5BD6.png https://i.imgur.com/Rbk5BD6.png Bing: https://i.imgur.com/zVJ1tu6.png https://i.imgur.com/zVJ1tu6.png -- So, how would one explain 80s folks what even an LLM is when we cant even ELI5 2024?

LeoPanthera 3y ago
In a way that someone in the 80s could understand? An LLM is a very highly compressed store of knowledge combined with an advanced parser than understands questions in plain English. A consequence of the compression is that sometimes the answers lose some accuracy, which is a deliberate trade-off to make it work at all.
- samstave 3y ago
  Now paint me a picture of a cat. Good LLM.
  - AlexeyBelov 3y ago
    LLMs don't paint.
- NikkiA 3y ago
  Neural networks were known about in the 80s, they were theorised about in the 1800s ffs, and the first computer based NNs were in the 1950s.
throwbadubadu 3y ago
My story plot would sure include LLM (coefficients file as today) + code to run it. So 80s humans could run it on the Cray, ask it questions, and get answers (after some time :D). LLM could explain itself what it is.. (if there are not more important questions to ask, contention would ensue).
bee_rider 3y ago
I don’t think they’d have any trouble with the math, it’s just a bunch of regressions and matvecs, right? I think the process of collecting and storing all the data would be more mind blowing to them—of course they were at the beginning of Moore’s law, so they could see the trajectory if they looked for it, but it is one thing to stand on the coast with waves lapping at your ankles and imagine how the ocean gets deeper as you keep going and another to get chucked out of a helicopter in the middle of the Pacific.
d0mine 3y ago
LLM is a lossy compression of the internet. We can provide it in a form that is directly executable on 80s computers though gpt4 tries to convince me that it is practically impossible the reduced model would be much weaker (somebody doesn't want to be sent to 80s ;)
worewood 3y ago
Yes, that means just a multi gig file. The hard part of LLMs (and current AI in general) is training, which is orders of magnitude harder than inference. If somehow we had a way to travel to the future in the 70s, train the models and then come back, we would be in Star Trek right now

dekhn 3y ago

I can't find it now but I wrote a bit of fanfic where Ken Thompson sent an LLM back in time (referencing his "Love, Ken" UNIX tapes that he would send out) to save humanity. He was always a bit head of his time.