6 ms·
What does it even mean to lie for a text generator? It outputs the most probable continuation of the given input and that continuation is indeed the most probab
by akomtu 3y ago
What does it even mean to lie for a text generator? It outputs the most probable continuation of the given input and that continuation is indeed the most probable in its training dataset. We don't say that DNA sequences are true or false.
- HarHarVeryFunny 3y agoGood prediction involves modelling the data generator, including hidden state such as level of knowledge or uncertainly, motivation, or tendency to lie. If you ask a question of someone/something who is ill equipped to answer, then (assuming you have not modeled them as inveterate bullshitter) a good predicted response is "I don't know". Deliberately lying due to a motivation to deceive is different from the default LLM mode of "just keep talking" bullshitting. The only "motivation" an LLM has is to predict next word, but if it knows that this requires lying then it will do so (e.g. give it a setup where it is someone motivated to lie).