4 ms·
> it's a language model, not a paragon of truth Several comments have missed that the article is not about the underlying language model, but about the content
by sampo 4y ago
> it's a language model, not a paragon of truth
Several comments have missed that the article is not about the underlying language model, but about the content moderation system that OpenAI put in front of the actual language model. So that people don't interact directly with the "raw" language model.
- beepbooptheory 4y agoWhich if you read the article is in fact a different "machine learning model from the GPT family."
- mnkv 4y agoThe important difference between the LM and the content moderation system (itself built on top of an LM) is their training objective. LM is doing next-word prediction (or human-preference prediction with RLHF), whereas the content moderation is likely finetuned to explicitly identify hate etc... So while the LM is not supposed to output "truth", the content moderation system should correctly classify "hate" because that is its training objective