13 ms·
Tangential question: Is GPT-3 (and similar tools) being kept up to date with new information? Or would it basically have to be retrained from scratch to properl
by layer8 4y ago
Tangential question: Is GPT-3 (and similar tools) being kept up to date with new information? Or would it basically have to be retrained from scratch to properly incorporate new data?
- simonw 4y agoThere's a mechanism you can use to add your own training data on top of GPT-3. This tutorial talks about using that to generate song lyrics (about half way through): https://wingedsheep.com/songwriting-with-gpt-3/ https://wingedsheep.com/songwriting-with-gpt-3/ I don't know how often OpenAI build new versions of the core GPT-3 language model.
- abirch 4y agoWhat would be highly beneficial is for the AI to understand changes so when it spots an old pattern in my code, it could suggest the new pattern. I'd pay for a Copilot that did that.
- oefrha 4y agoCopilot: “You’re using yesterday’s JavaScript framework of the day. Please rewrite your app in today’s JavaScript framework of the day.” Jokes aside, I wonder when we’ll see an official language linter (go vet, rust-clippy, etc.) that is an ML black box instead of a traditional handcrafted deterministic rule-based engine.