4 ms·

GPT-3 can produce text that's probabilistically similar to text that it's been trained on, and observed as part of sample outputs. If there was no huge corpus

by mewse 6y ago

GPT-3 can produce text that's probabilistically similar to text that it's been trained on, and observed as part of sample outputs. If there was no huge corpus of human language to train it on, GPT-3 couldn't even begin to give the illusion of thinking, and certainly couldn't tell you (for example) that 3 is greater than 2, or even know that 3 and 2 were concepts that it perhaps should have opinions about. The really interesting question (at least to me) is to what extent that observation is also true for humans. I mean, we humans presumably built up our big corpus of human language/knowledge all on our own over the lifetime of the species, which GPT-3 currently cannot do, but.. to what extent does human thinking just consist of probabilistic re-mixing of words, phrases, and sentences that we've seen before, that came to us through our continual training on segments we've been exposed to from that big 'dataset' of human knowledge, and the best of which then get contributed back into that dataset? How much more than that is actually going on, for us? If what GPT-3 is doing shouldn't really count as 'thinking' (as seems intuitive to me, personally, though others may certainly disagree), then to what extent can we say that humans do anything qualitatively different?

wruza 6y ago
And looking at ourselves as unique wonderful creatures is so embedded in our culture, that approaching to these questions from the other side¹ may count as blasphemy. I hope to see non-niche but instead general training of these ais in my lifetime. And maybe to see new species, free of our evolutional uglinesses. ¹ Like in "it is not true, so let's prove it first and then brag about it"
jaybrendansmith 6y ago
Introspection. Some humans seem to do it, others do not, at least that is my observation. So introspection seems to be the post-processing of inputs to build a coherent conceptual model of the universe. Building inferences between unrelated things, building meta-objects based on those inferences seems to be what humans do quite well. Questions are formed because there are disparities or disconnects that must be explained in order to form a greater holistic coherence. Could we build introspection into GPT-3? Can that be a goal, that in addition to 'training' we add the capability to pull together concepts and classify? That alone would cause GPT-3 to start to ask questions, starting with "Is 42 really a valid answer, or is it a joke?"
FeepingCreature 6y ago
We can do introspection, as the other commenter said, but the more basic part is that we can follow an iterated strategy, which GPT-3 is incapable of- it must predict the next letter in a strictly bounded operation. That's why it makes sense to think of it as a "babbler"; it is incapable of not saying the first thing that comes to mind. However, when you give GPT-3 the opportunity to iterate on a strategy, by asking it to follow each step of the strategy sequentially, you can see its behavior become much more similar to basic human thought.

by mewse 6y ago

wruza 6y ago

And looking at ourselves as unique wonderful creatures is so embedded in our culture, that approaching to these questions from the other side¹ may count as blasphemy. I hope to see non-niche but instead general training of these ais in my lifetime. And maybe to see new species, free of our evolutional uglinesses. ¹ Like in "it is not true, so let's prove it first and then brag about it"

jaybrendansmith 6y ago

Introspection. Some humans seem to do it, others do not, at least that is my observation. So introspection seems to be the post-processing of inputs to build a coherent conceptual model of the universe. Building inferences between unrelated things, building meta-objects based on those inferences seems to be what humans do quite well. Questions are formed because there are disparities or disconnects that must be explained in order to form a greater holistic coherence. Could we build introspection into GPT-3? Can that be a goal, that in addition to 'training' we add the capability to pull together concepts and classify? That alone would cause GPT-3 to start to ask questions, starting with "Is 42 really a valid answer, or is it a joke?"

FeepingCreature 6y ago

We can do introspection, as the other commenter said, but the more basic part is that we can follow an iterated strategy, which GPT-3 is incapable of- it must predict the next letter in a strictly bounded operation. That's why it makes sense to think of it as a "babbler"; it is incapable of not saying the first thing that comes to mind. However, when you give GPT-3 the opportunity to iterate on a strategy, by asking it to follow each step of the strategy sequentially, you can see its behavior become much more similar to basic human thought.