4 ms·
A transformer that doesn't hallucinate (or knows what is a hallucination) would be the ultimate compression algorithm. But right now that isn't a solved problem
by Workaccount2 1y ago
A transformer that doesn't hallucinate (or knows what is a hallucination) would be the ultimate compression algorithm. But right now that isn't a solved problem, and it leaves the output of LLMs too untrustworthy to use over what are colloquially known as compression algorithms.
- Nevermark 1y agoIt is still task related. Compressing a comprehensive command line reference via model might introduce errors and drop some options. But for many people, especially new users, referencing commands, and getting examples, via a model would delivers many times the value. Lossy vs. lossless are fundamentally different, but so are use cases.