3 ms·

I think the true importance of GPT-3 is its general learning ability across multiple domains. David Chalmers wrote about this recently: > More remarkably, GPT-

by thorum 6y ago

I think the true importance of GPT-3 is its general learning ability across multiple domains. David Chalmers wrote about this recently: > More remarkably, GPT-3 is showing hints of general intelligence. Previous AI systems have performed well in specialized domains such as game-playing, but cross-domain general intelligence has seemed far off. GPT-3 shows impressive abilities across many domains. It can learn to perform tasks on the fly from a few examples, when nothing was explicitly programmed in. It can play chess and Go, albeit not especially well. Significantly, it can write its own computer programs given a few informal instructions. It can even design machine learning models. Thankfully they are not as powerful as GPT-3 itself (the singularity is not here yet). source: http://dailynous.com/2020/07/30/philosophers-gpt-3/#chalmers http://dailynous.com/2020/07/30/philosophers-gpt-3/#chalmers

echelon 6y ago
HTML is a declarative grammar, so it entirely makes sense that GPT-3 can generate signal in this domain. It's just another shape. A sine wave signal. Show it a pattern of waves and it'll duplicate the ripples. Pretty neat stuff, but nothing to get existentially worried about. I'll fall off my chair when a model can write fizzbuzz. I think we have a ways to go.
- TeMPOraL 6y ago
  I hope you have your mattress ready by your chair, because I just put this prompt in AI dungeon: $ You are a fresh CS grad. You're preparing for a job interview. You ask on StackOverflow: "how to write a FizzBuzz program?" And, repeatedly pressing <Enter>, I got the following: > The first response is from an experienced coder who has been programming for 20 years and knows the answer. He writes: "FizzBuzz is a simple algorithm that can be written in one line of code." > He goes on to explain how you should implement it, but he doesn't bother to give any examples or explanations. It's all very basic and obvious. > Then comes another coder with 10 years experience. This guy has a lot more knowledge about programming languages than the first one did, so he gives you some pointers. Although his advice is useful, it's still fairly basic. > Then, someone with only 2 years experience answers. They give you some simplistic examples. At this point, I add: $ The first example looks like: And the game immediately wrote the following: int fizzBuzz ( int number ) { if ( number % 3 == 0 && number % 5 == 0 ) printf ( "FizzBuzz" ); if ( number % 3 == 0 ) printf ( "Fizz" ); if ( number % 5 == 0 ) printf ( "Buzz" ); if ( number % 3 ! = 0 && number % 5 ! = 0 ) printf ( "%d" , number ); printf ( " " ); return 0 ; } (Yeah, I know it hasn't really learned to code, but it apparently does have it encoded in its model.)

by thorum 6y ago

echelon 6y ago

HTML is a declarative grammar, so it entirely makes sense that GPT-3 can generate signal in this domain. It's just another shape. A sine wave signal. Show it a pattern of waves and it'll duplicate the ripples. Pretty neat stuff, but nothing to get existentially worried about. I'll fall off my chair when a model can write fizzbuzz. I think we have a ways to go.

TeMPOraL 6y ago
I hope you have your mattress ready by your chair, because I just put this prompt in AI dungeon: $ You are a fresh CS grad. You're preparing for a job interview. You ask on StackOverflow: "how to write a FizzBuzz program?" And, repeatedly pressing <Enter>, I got the following: > The first response is from an experienced coder who has been programming for 20 years and knows the answer. He writes: "FizzBuzz is a simple algorithm that can be written in one line of code." > He goes on to explain how you should implement it, but he doesn't bother to give any examples or explanations. It's all very basic and obvious. > Then comes another coder with 10 years experience. This guy has a lot more knowledge about programming languages than the first one did, so he gives you some pointers. Although his advice is useful, it's still fairly basic. > Then, someone with only 2 years experience answers. They give you some simplistic examples. At this point, I add: $ The first example looks like: And the game immediately wrote the following: int fizzBuzz ( int number ) { if ( number % 3 == 0 && number % 5 == 0 ) printf ( "FizzBuzz" ); if ( number % 3 == 0 ) printf ( "Fizz" ); if ( number % 5 == 0 ) printf ( "Buzz" ); if ( number % 3 ! = 0 && number % 5 ! = 0 ) printf ( "%d" , number ); printf ( " " ); return 0 ; } (Yeah, I know it hasn't really learned to code, but it apparently does have it encoded in its model.)