3 ms·
Hypothesis: ChatGPT trains on humans' neural networks, not just data
- ricopags 4y agoThis is known. The HF in RLHF upon which InstructGPT is fine-tuned is human feedback. With so many people offering their take on this new technology, perhaps it's important to at least read a little before writing about it.
- jayhoon 4y agoThis is "known" as "proven" or as in "suggested by others previously"? Obviously, answers are tuned by humans (as the OP agrees), but does the GPT model train against the human neural network? The main question holds, still: will the human IQ limit the capabilities of GPT and other models?
- dragonwriter 4y ago> The main question holds, still: will the human IQ limit the capabilities of GPT and other models? Unless the models of a way of assessing output quality independent of, superior to, and which trumps input provided by humans, yes.
- jayhoon 4y agoThis (inadvertently) can happen when the model size goes over what humans can oversee. Unless human input gets much higher weight.