5 ms·
Why isn't it read-only by default? it's not even connected to the internet
by johntiger1 4y ago
Why isn't it read-only by default? it's not even connected to the internet
- ben_w 4y agoChatGPT, and I think all the GPT LLMs, is only accessible over the internet as far as I can tell. And the thumbs up/down are there on the chat interface because it's partly trained by reinforcement from human feedback.
- famouswaffles 4y agoNope. LLMs don't use the internet for inference at all unless you give it access to a web search api or something like that. chtGPT is just too massive to run on any local machine. But make no mistake, it does not require the internet.
- ben_w 4y agoI didn't say "for inference", and neither did the person I replied to. GPT uses the internet to connect to users, but rather more importantly chatGPT in particular has a layer on top of GPT which is trained from human feedback. Keywords search "RLHF". That feedback mechanism is, if anything, becoming more detailed as time passes, so I must infer that it's still considered highly important, probably even for the 3.5 model.
- famouswaffles 4y agoThe model isn't being trained as time goes on.
- ben_w 4y agoThe RLHF layer is, and that layer is important. That it does any of this is the specific reason for the story you're commenting on, and why putting data into it isn't like putting the same data into e.g. a Google Docs spreadsheet.