4 ms·
“All models are wrong. Some are useful.” - George Box
by coherentpony 25d ago
“All models are wrong. Some are useful.” - George Box
- jephs 25d agoThe poor fellow just rolled over. what an incandescently vulgar abuse of notation.
- coherentpony 17d agoNot really. LLMs are intended to model language. This is clear by observing how people expect them to respond when asked questions. The implementation of that model is akin to “pick the next word with highest probability”. In some contexts, this is absolutely the wrong thing to do. In some contexts the LLM will give you totally the wrong sentiment, or even an incorrect fact. Humans call those “misalignments”, or “hallucinations”, or whatever other softened or anthropomorphised language to play down the problem. The reality is that sometimes they are wrong. The model is wrong. It is not an abuse of notation at all.