Isn't hallucinating a very wrong word? Hallucinating should be about twisted input misinterpretation. E.g. if the text input you give them was malformed at som

Isn't hallucinating a very wrong word? Hallucinating should be about twisted input misinterpretation. E.g. if the text input you give them was malformed at some level. What they are doing is try to give you an answer based on compressed knowledge, which might be true, but might not because it's compressed and lossy. Because they are trained to bias to give an answer even if it's not 100% clear from compressed knowledge. The larger the model, the less compressed the knowledge and better they would be able to differ when it is something they know vs something that they likely don't.