4 ms·
I'm working on this. I've been training on Stack Overflow and the model has already learned the syntaxes and common coding conventions of a bunch of different
by yeldarb 7y ago
I'm working on this.
I've been training on Stack Overflow and the model has already learned the syntaxes and common coding conventions of a bunch of different languages all on its own. Excited to see what else it's able to do as I keep experimenting.
Some sample outputs (you'll probably want to browse to some of the "Random" questions because by default it's showing "answers" right now and I haven't trained that model as long as some of the older question-generation ones): https://stackroboflow.com https://stackroboflow.com
- lucidrains 7y agoI've tried it as well and got good syntactic results. For more sensical programs, I think we will need more layers & attn heads. Perhaps someone will fork gpt-2 and add the sparse transformer to it.
- mgalgs 7y agoThese are actually a lot of fun to read. Kudos!