4 ms·
I thought that was about LLMs being trained on compressed data. But I might be thinking about a different paper.
by jmholla 3y ago
I thought that was about LLMs being trained on compressed data. But I might be thinking about a different paper.
- dragonwriter 3y agoGzip + kNN for text classification: https://aclanthology.org/2023.findings-acl.426.pdf https://aclanthology.org/2023.findings-acl.426.pdf
- junipertea 3y agoNot LLM, just BERT, also did not actually outperform it. source: https://kenschutte.com/gzip-knn-paper/ https://kenschutte.com/gzip-knn-paper/