4 ms·
> Again, it fundamentally has no understanding of 'lying' or 'correctness' and it cannot disagree with you except when explicitly told to do so. It obviously d
by xcv123 3y ago
> Again, it fundamentally has no understanding of 'lying' or 'correctness' and it cannot disagree with you except when explicitly told to do so.
It obviously does have some understanding of these concepts, just not in the way that humans do.
> The only thing that marginally stops it from going off the rails is the extensive prompting they do under the hood
No, its a combination of pre-training and fine tuning. They train the model to stay within guidelines. They don't prompt the model post-training to stay within guidelines. Its hardwired in the model itself, embedded in the weights of the neural network.