3 ms·
If LLMs did remember everything said it would be a lossless compression algorithm too….
by zitterbewegung 2y ago
If LLMs did remember everything said it would be a lossless compression algorithm too….
- Hugsun 2y agoIt would certainly be lossy. We don't know how to make them reliably know any particular facts. Neither training or in context learning does this without fail.