3 ms·

I've worked with the various LLMS quite a lot at this point (for someone who doesn't do it professionally ... well, I guess I sort of do ... but not for any of

I've worked with the various LLMS quite a lot at this point (for someone who doesn't do it professionally ... well, I guess I sort of do ... but not for any of the companies who make them.) Anyway, it's amazing how close these are to what our old (i.e., GOFAI) Spreading Activation models form the 1970s would do. You can wikipedia it FMI, but in practice the SA models would be loaded up with a context, and then the SA would keep it one track for a while, but as you got farther from the priming context it was very very hard to get it not to eventually spin off into some quasi-relevant confabulation. I think that the embeddings is just a modern way of creating a non-discrete semantic net, and the GPT is just implementing the moral equivalent of spreading activation.

eternalban 3y ago
(trying to understand your comment) This FMI? (https://fmi-standard.org/ https://fmi-standard.org/) And what do you mean by "moral equivalent"?
- fhars 3y ago
  From the context of the sentence, my most likely guess is "for more information", but yes, that comment is a prime example for "how not to write if you want to be understood".
  - abrax3141 3y ago
    https://simple.m.wikipedia.org/wiki/Moral_equivalence https://simple.m.wikipedia.org/wiki/Moral_equivalence
- abrax3141 3y ago
  Sorry. The couple of typos don’t help. (I tried to edit them but it was too late.) Yes, per @fhars, “fmi” is pretty common text-speak for “for more info” (which google will tell you if you search for it). “Morally equivalent” is a term used in the classical hacker community to mean something like “essentially the same as, although not technically Computationally equivalent”. (And, as I noted below, it is also a standard, if a bit obscure, English phrase: https://simple.m.wikipedia.org/wiki/Moral_equivalence https://simple.m.wikipedia.org/wiki/Moral_equivalence)
  - eternalban 3y ago
    np. Thanks for the clarification. The discreet bit was clear but TIL re classic hacker speak.

eternalban 3y ago

(trying to understand your comment) This FMI? (https://fmi-standard.org/ https://fmi-standard.org/) And what do you mean by "moral equivalent"?

fhars 3y ago
From the context of the sentence, my most likely guess is "for more information", but yes, that comment is a prime example for "how not to write if you want to be understood".
- abrax3141 3y ago
  https://simple.m.wikipedia.org/wiki/Moral_equivalence https://simple.m.wikipedia.org/wiki/Moral_equivalence
abrax3141 3y ago
Sorry. The couple of typos don’t help. (I tried to edit them but it was too late.) Yes, per @fhars, “fmi” is pretty common text-speak for “for more info” (which google will tell you if you search for it). “Morally equivalent” is a term used in the classical hacker community to mean something like “essentially the same as, although not technically Computationally equivalent”. (And, as I noted below, it is also a standard, if a bit obscure, English phrase: https://simple.m.wikipedia.org/wiki/Moral_equivalence https://simple.m.wikipedia.org/wiki/Moral_equivalence)
- eternalban 3y ago
  np. Thanks for the clarification. The discreet bit was clear but TIL re classic hacker speak.