4 ms·
This has been reinforcement learning for decades. People say "OMG! The agent is acting and learning and getting better all on its own!" And they're right, in th
by Buttons840 4y ago
This has been reinforcement learning for decades. People say "OMG! The agent is acting and learning and getting better all on its own!" And they're right, in the beginning. Eventually the agent plateaus or collapses.
Supervised learning is much more stable. GTP is supervised learning. Once you start letting the agent choose or modify its own training data, then you're moving towards the much less stable realms of reinforcement learning.
- AnimalMuppet 4y agoWell... humans who pick their own "training data" can wind up in echo chambers and, shall we say, diverging from reality. I don't think we're on the threshold of AGI, but it's interesting that the wanna-be AIs are running into human issues...
- Buttons840 4y agoTrue. I've read a lot about reinforcement learning and the exploration vs exploitation tradeoff is both technically interesting and philosophically interesting. I've also seen algorithms I've implemented fall to all sorts of human-ish flaws, such as learned helplessness, etc.
- qualudeheart 4y agoHumans who pick their own training data can make greats results by chosing which courses at college or grad school to attend.
- dontwearitout 4y agoGPT is not supervised learning, it is self-supervised learning (a form of unsupervised learning) since the learning objective is "fill in the missing training data".