3 ms·
Lots of lead up to it, but the punchline is: "My current mental model of ChatGPT is that it’s akin to a “Maximum Likelihood Estimator for the Entirety of Human
by andreyk 3y ago
Lots of lead up to it, but the punchline is:
"My current mental model of ChatGPT is that it’s akin to a “Maximum Likelihood Estimator for the Entirety of Human Knowledge”. There are two very different ways to interpret that: (1) Meh, it’s just a silly stats trick and (2) Holy F**ing Shit!!"
This is almost right... It's a fair way to think of GPT3/4 (sort of), but given RLHF ChatGPT is a pretty different beast.
Anyway, a pretty hand wavy kind of analysis, I was not a fan.
- neovialogistics 3y agoIt's a simulator. It simulates appropriate outputs to a given input. RL of any kind is just tweaking the definition of appropriate.
- jxf 3y agoThis is my sentiment too; I'm curious about if the OP agrees with this or not because there's a lot of variation in opinion here.
- edelans 3y agoRLHF = Reinforcement learning from human feedback https://en.wikipedia.org/wiki/Reinforcement_learning_from_human_feedback https://en.wikipedia.org/wiki/Reinforcement_learning_from_hu...
- deleted 3y ago[deleted]