3 ms·
That’s even the way babies learn to talk No, it's not. Babies learn to talk by babbling, and then by taking cues from their parents which babbles elicit a resp
by tremon 4y ago
That’s even the way babies learn to talk
No, it's not. Babies learn to talk by babbling, and then by taking cues from their parents which babbles elicit a response and which don't. If you want to translate that to AI, it would mean that the AI would spew random garbage and then learn to filter its garbage from the responses to its outputs. That's pretty far away from what ChatGPT and other language models are doing right now, because they stop learning before they start producing any output.
- TuringTest 4y agoYou haven't heard about RLHF, have you?
- TeMPOraL 4y agoThat's like teaching a baby to speak by recording it for a month while not reacting to it, and then forming a committee to analyze the recordings and conduct a high-intensity training session with the baby.
- dingclancy 4y agoActually if ChatGPT gives you a bad/wrong answer, and you reply telling it is wrong and why it is wrong, it will answer with something that you think is correct. So you are already doing a kind of real time RLHF in the chat. That is how DAN was prompted to exist.
- TeMPOraL 4y agoWell, correct me if I'm wrong, but if I do what you describe, all the learning will be gone when I close the tab, or even when I chat to it some more, so that my correction falls out of its context window.
- int_19h 4y agoThat just means that it doesn't have a long-term memory. This is not an intrinsic limitation - you can give those things access to some larger storage of information and tell them how they can query it, and they will (try to) do that. It's exactly how Bing AI does relevant searches, for example.