4 ms·
Sort of, but isn't the focus on prompts a bit myopic? The huge difference between earlier GPTs and ChatGPT was RLHF, which not only makes it better at following
by PumpkinSpice 3y ago
Sort of, but isn't the focus on prompts a bit myopic? The huge difference between earlier GPTs and ChatGPT was RLHF, which not only makes it better at following prompts, but also enforces a lot of hidden dogma. It certainly influences how ChatGPT talks about climate change or AI risks, for example.
- jojobas 3y agoTraining crap is way more complicated than prompt predication and also limiting the flexibility of the model. You'd be hard pressed to train a visual model so that every group of 3 or more people is "ethnically diverse". Also ChatGPT climate, race and many other reponses are short-circuited to boilerplate answers, not dogma-trained.