3 ms·
I don't really understand. How is GPT-3 able to do this? Understanding English is one thing, but how did it learn JavaScript, HTML, CSS, and the React framework
by aerovistae 6y ago
I don't really understand. How is GPT-3 able to do this? Understanding English is one thing, but how did it learn JavaScript, HTML, CSS, and the React framework?
- jpindar 6y agoIt doesn't understand English. It knows how to make up text that looks a lot like the text that it read. It read a lot of examples of code, so it know how to make up code that looks a lot like what it read. Some of this code works, since some of what it read works. But if it read too much non-working code from stack overflow questions, it might write code that doesn't work. Edit: apparently it read a lot of Github repositories, so most of what it mimics is working code.
- andreaorru 6y agoApparently it was trained over GitHub repositories. https://youtu.be/fZSFNUT6iY8 https://youtu.be/fZSFNUT6iY8
- aerovistae 6y agoWhat I'm wondering is how it matched up the natural english description with the repository content though.
- p49k 6y agoProbably through tutorials and verbosely-commented code examples?
- taylorfinley 6y agoI'd like to see this done with tests as the input, and the working app as the output. Then writing an app would be as simple as defining the tests it must pass.
- FabioBertone 6y ago> Then writing an app would be as simple as defining the tests it must pass In most cases, if you can define the tests, you have already figured out 80% of the solution.
- zumachase 6y agoThe prompt contained a few react examples with annotated English descriptions that were similar enough. You’re not seeing the entire prompt and as impressive as this is, it’s likely that you’d end up writing more code trying to get it to do what you want than if you just wrote it yourself. Future GPTs may of course be better, but there’s a bit of “magic” to these demos that the author isn’t super upfront about.
- deleted 6y ago[deleted]