3 ms·

Thanks, this is a great explanation but also reinforces my initial sense of "strong typing" being kind of a woo term here. Nevertheless, I learned something in

Thanks, this is a great explanation but also reinforces my initial sense of "strong typing" being kind of a woo term here. Nevertheless, I learned something interesting. I would love to know more about the definition of "what" in the language model context. It's just so mind-boggling, using models like GPT-3 it is obvious that there is some kind if emergent semantics cognition, but then it also quickly falls apart at every other prompt.

gitfan86 4y ago
Yes, you are right, so far the biggest discovery of this century is that intelligence emerges from large enough networks of digital neurons trained in large enough datasets. It isn't perfect, or super human at all. But the crazy thing is that these abilities are doubling every 6 months.