5 ms·

This is a really cool demo, and congrats to the creator for making something really cool. However, while these systems based on GPT-3, and similar techniques,

This is a really cool demo, and congrats to the creator for making something really cool. However, while these systems based on GPT-3, and similar techniques, can produce some amazing outputs given the right inputs, you don't have to poke them very hard before they start falling apart. At the end of the day, this isn't really any more "clever" than a very, very advanced and long markov chain, there isn't any intelligence.

rbinv 6y ago
> At the end of the day, this isn't really any more "clever" than a very, very advanced and long markov chain, there isn't any intelligence. https://en.wikipedia.org/wiki/AI_effect https://en.wikipedia.org/wiki/AI_effect - at least sort of I get what you're saying, but is this really as fragile as you claim? I've been rather impressed by (GPT) input handling.
- CJefferson 6y ago
  I would never have thought this type of thing was clever. I don't want to pull expertise but I've been an AI research for 20 years, thinking this stuff isn't clever isn't new for me :) If anything, this is "less clever" than older techniques like tree-search, as it is very easy to confuse, and will start just producing nonsense.
dumb1224 6y ago
I often wonder how much (percentage-wise) the model is 'encoding' certain knowledge, the equivalent being how much does a person know about web development etc. A lot of research are using transfer learning in this fashion, which assumes most of or at least a large chunk of trained weights are relevant to a different task they are attempting (in contrast to the model was originally trained for). So if coding these UI requires very little language skill then you are really using a very small part of the model (or am I too naive)?
YeGoblynQueenne 6y ago
That's true, but who said that the goal is intelligence? This is clearly a demo from a startup that sells this kind of service [1]. All that's needed is something that can be made to work under certain business-dictated constraints. Nobody really needs these things to be actually smart. Or, seen another way, it just has to be smarter than most peoples' web frameworks, or perhaps their IDEs, which is not a very high bar. _________________ [1] Going by Sharif Shameem's Twitter profile (or bio, whatsitcalled): founder at https://debuild.co https://debuild.co – a faster way to develop web apps // @ycombinator alum // prev built @VectordashGPU // relentlessly optimistic
- polyanos 6y ago
  I can see GPT-3 being used in a tool/add-on ala Intellisense or Tabnine, but as something to create "a way for anyone to ship a functional web app just by describing what it should do in natural language" (quoted from his website) I'm positive that we have to wait for at least a GPT version that doesn't get confused after ~200-300 words. I guess you could create some kind of UI prototyping app, but better options for that already exist, which don't require you to write everything out.

rbinv 6y ago

> At the end of the day, this isn't really any more "clever" than a very, very advanced and long markov chain, there isn't any intelligence. https://en.wikipedia.org/wiki/AI_effect https://en.wikipedia.org/wiki/AI_effect - at least sort of I get what you're saying, but is this really as fragile as you claim? I've been rather impressed by (GPT) input handling.

CJefferson 6y ago
I would never have thought this type of thing was clever. I don't want to pull expertise but I've been an AI research for 20 years, thinking this stuff isn't clever isn't new for me :) If anything, this is "less clever" than older techniques like tree-search, as it is very easy to confuse, and will start just producing nonsense.

dumb1224 6y ago

I often wonder how much (percentage-wise) the model is 'encoding' certain knowledge, the equivalent being how much does a person know about web development etc. A lot of research are using transfer learning in this fashion, which assumes most of or at least a large chunk of trained weights are relevant to a different task they are attempting (in contrast to the model was originally trained for). So if coding these UI requires very little language skill then you are really using a very small part of the model (or am I too naive)?

YeGoblynQueenne 6y ago

That's true, but who said that the goal is intelligence? This is clearly a demo from a startup that sells this kind of service [1]. All that's needed is something that can be made to work under certain business-dictated constraints. Nobody really needs these things to be actually smart. Or, seen another way, it just has to be smarter than most peoples' web frameworks, or perhaps their IDEs, which is not a very high bar. _________________ [1] Going by Sharif Shameem's Twitter profile (or bio, whatsitcalled): founder at https://debuild.co https://debuild.co – a faster way to develop web apps // @ycombinator alum // prev built @VectordashGPU // relentlessly optimistic

polyanos 6y ago
I can see GPT-3 being used in a tool/add-on ala Intellisense or Tabnine, but as something to create "a way for anyone to ship a functional web app just by describing what it should do in natural language" (quoted from his website) I'm positive that we have to wait for at least a GPT version that doesn't get confused after ~200-300 words. I guess you could create some kind of UI prototyping app, but better options for that already exist, which don't require you to write everything out.