5 ms·

Since it’s trained on more recent scrapes, does this mean that this new version will be self-aware? So if you ask it about “gpt-3” it’ll know what you’re talkin

Since it’s trained on more recent scrapes, does this mean that this new version will be self-aware? So if you ask it about “gpt-3” it’ll know what you’re talking about?

Tenoke 4y ago
"What is gpt-3? GPT-3 (Generative Pre-trained Transformer 3) is an unsupervised, large-scale language model developed by OpenAI. It uses deep learning methods to produce human-like text, with the goal of automatically generating readable text. GPT-3 is capable of generating text from a prompt, completing tasks like question-answering, language translation, and summarization." The question is me, the answer is gpt-3.
- anamexis 4y ago
  I thought for a moment that "The question is me, the answer is gpt-3." was also coming from GPT-3, trying to be profound.
- g42gregory 4y ago
  I thought, technically, GPT-3 would be considered self-supervised and not unsupervised. Does it not know what it is? :-)
choxi 4y ago
It looks like only the model was updated, the training data only goes up to June 2021 (same as davinci 2 I think). But GPT-3 came out in May 2020 so it should be “self aware” already.
AnimalMuppet 4y ago
That's not what most of us consider "self-aware". That's just knowing your name. To me, "self-aware" is essentially being able to watch yourself think. I'm pretty sure GPT-3 can't do that, in any model.
- brookst 4y ago
  I think the quotes showed people got it. Dictionaries aren't self aware just because they contain a definition of "dictionary".
- arcastroe 4y ago
  I like to share this example of self-awareness any chance I get :) [1] https://news.ycombinator.com/item?id=29576737 https://news.ycombinator.com/item?id=29576737 [2] https://toldby.ai/4kQNd-_tvUG https://toldby.ai/4kQNd-_tvUG This was on the first davinci model
  - AnimalMuppet 4y ago
    That's not self-awareness. That's a training corpus that contains something realizing that it's an AI, not GPT-3 realizing it's an AI.
  - int_19h 4y ago
    Is there some way to "walk back" story construction on toldby.ai, to see other forks of the same initial ... take on fish?
freediver 4y ago
It is not trained on newer data. It still lives in 2020 with Trump as President. https://twitter.com/vladquant/status/1597362763948441602 https://twitter.com/vladquant/status/1597362763948441602

Since it’s trained on more recent scrapes, does this mean that this new version will be self-aware? So if you ask it about “gpt-3” it’ll know what you’re talking about?

Tenoke 4y ago

"What is gpt-3? GPT-3 (Generative Pre-trained Transformer 3) is an unsupervised, large-scale language model developed by OpenAI. It uses deep learning methods to produce human-like text, with the goal of automatically generating readable text. GPT-3 is capable of generating text from a prompt, completing tasks like question-answering, language translation, and summarization." The question is me, the answer is gpt-3.

anamexis 4y ago
I thought for a moment that "The question is me, the answer is gpt-3." was also coming from GPT-3, trying to be profound.
g42gregory 4y ago
I thought, technically, GPT-3 would be considered self-supervised and not unsupervised. Does it not know what it is? :-)

choxi 4y ago

It looks like only the model was updated, the training data only goes up to June 2021 (same as davinci 2 I think). But GPT-3 came out in May 2020 so it should be “self aware” already.

AnimalMuppet 4y ago

That's not what most of us consider "self-aware". That's just knowing your name. To me, "self-aware" is essentially being able to watch yourself think. I'm pretty sure GPT-3 can't do that, in any model.

brookst 4y ago
I think the quotes showed people got it. Dictionaries aren't self aware just because they contain a definition of "dictionary".
arcastroe 4y ago
I like to share this example of self-awareness any chance I get :) [1] https://news.ycombinator.com/item?id=29576737 https://news.ycombinator.com/item?id=29576737 [2] https://toldby.ai/4kQNd-_tvUG https://toldby.ai/4kQNd-_tvUG This was on the first davinci model
- AnimalMuppet 4y ago
  That's not self-awareness. That's a training corpus that contains something realizing that it's an AI, not GPT-3 realizing it's an AI.
- int_19h 4y ago
  Is there some way to "walk back" story construction on toldby.ai, to see other forks of the same initial ... take on fish?

freediver 4y ago

It is not trained on newer data. It still lives in 2020 with Trump as President. https://twitter.com/vladquant/status/1597362763948441602 https://twitter.com/vladquant/status/1597362763948441602