2 ms·
This makes it sound like LLMs are sentient and machiavellian, when they are just dumb statistical generators. An LLM doesn't have any goals other than the biase
by HarHarVeryFunny 2y ago
This makes it sound like LLMs are sentient and machiavellian, when they are just dumb statistical generators. An LLM doesn't have any goals other than the biases the model trainers chose to impart via RLHF, aside from which it is just trying to predict "what would the training data have said".
If you insist on anthromorphizing the model, then it's goal is to please the RLHF testers, subject to pulling from the repertoire of responses that are statistically faithful to the training data.