2 ms·
> But then companies go train them on "The Internet". This is the bit that I think a lot of people miss. If the model was trained on stuff from the internet, t
by JohnFen 3y ago
> But then companies go train them on "The Internet".
This is the bit that I think a lot of people miss. If the model was trained on stuff from the internet, then what the model will produce will reflect that, and the internet is chock full of bullshit.
Same thing about when LLMs produce objectionable responses (racist, violent, whatever). Those are a direct reflection of the nature of the training material.
- CuriouslyC 3y agoPretraining is "off the internet" but task training/rlhf is not.