3 ms·

> GPT-3 shows that it’s possible for a model to someday reach human levels of generalization in NLP This is a big, big claim tossed in as a throwaway line. GPT

> GPT-3 shows that it’s possible for a model to someday reach human levels of generalization in NLP This is a big, big claim tossed in as a throwaway line. GPT-3 shows that we haven't yet reached the limit of the "just throw more resources at it" school of AI development, but it doesn't automatically follow that it'll reach human levels of NLP if you give it enough resources. By analogy, this is claiming "New, larger steam locomotives are strictly faster than older, smaller ones, so this shows with enough coal it's possible for steam-engines to someday drive interstellar transport at 0.5c"

teruakohatu 6y ago
> By analogy, this is claiming "New, larger steam locomotives are strictly faster than older, smaller ones, so this shows with enough coal it's possible for steam-engines to someday drive interstellar transport at 0.5c" Making that argument about scaling up high energy fuels and engines would make interstellar travel possible would be a pretty good hypothesis. Turns out you need rocket fuel and rocket engines, not coal and steam engines. GPT-3 might not be the engine, but throwing insane amounts of electrical energy and computing power at the problem might just get us there.
jimmySixDOF 6y ago
>strictly faster The question is how fast is fast enough. At what point do you stop being able to distinguish an agenda determined social engineering bot from a non native speaking teenage 4chan troll ? The bar is not much higher - much less than the gain of function already seen from v2. So will it be v4? v5? For a lot of disruptive applications, just a little bit "faster" is all you need for the bad actors to act.
- quadrifoliate 6y ago
  > At what point do you stop being able to distinguish an agenda determined social engineering bot from a non native speaking teenage 4chan troll ? I'm...not sure why you would want to? I can't see either being particularly helpful regarding discourse on the Internet or in real life.

teruakohatu 6y ago

> By analogy, this is claiming "New, larger steam locomotives are strictly faster than older, smaller ones, so this shows with enough coal it's possible for steam-engines to someday drive interstellar transport at 0.5c" Making that argument about scaling up high energy fuels and engines would make interstellar travel possible would be a pretty good hypothesis. Turns out you need rocket fuel and rocket engines, not coal and steam engines. GPT-3 might not be the engine, but throwing insane amounts of electrical energy and computing power at the problem might just get us there.

jimmySixDOF 6y ago

>strictly faster The question is how fast is fast enough. At what point do you stop being able to distinguish an agenda determined social engineering bot from a non native speaking teenage 4chan troll ? The bar is not much higher - much less than the gain of function already seen from v2. So will it be v4? v5? For a lot of disruptive applications, just a little bit "faster" is all you need for the bad actors to act.

quadrifoliate 6y ago
> At what point do you stop being able to distinguish an agenda determined social engineering bot from a non native speaking teenage 4chan troll ? I'm...not sure why you would want to? I can't see either being particularly helpful regarding discourse on the Internet or in real life.