3 ms·
I didn't say "for inference", and neither did the person I replied to. GPT uses the internet to connect to users, but rather more importantly chatGPT in partic
by ben_w 4y ago
I didn't say "for inference", and neither did the person I replied to.
GPT uses the internet to connect to users, but rather more importantly chatGPT in particular has a layer on top of GPT which is trained from human feedback.
Keywords search "RLHF".
That feedback mechanism is, if anything, becoming more detailed as time passes, so I must infer that it's still considered highly important, probably even for the 3.5 model.
- famouswaffles 4y agoThe model isn't being trained as time goes on.
- ben_w 4y agoThe RLHF layer is, and that layer is important. That it does any of this is the specific reason for the story you're commenting on, and why putting data into it isn't like putting the same data into e.g. a Google Docs spreadsheet.