3 ms·
Wasn't there a paper recently about a fairly simple wrapper around a common conpression algorithm beating LLMs on classification tasks?
by dragonwriter 3y ago
Wasn't there a paper recently about a fairly simple wrapper around a common conpression algorithm beating LLMs on classification tasks?
- jmholla 3y agoI thought that was about LLMs being trained on compressed data. But I might be thinking about a different paper.
- dragonwriter 3y agoGzip + kNN for text classification: https://aclanthology.org/2023.findings-acl.426.pdf https://aclanthology.org/2023.findings-acl.426.pdf
- junipertea 3y agoNot LLM, just BERT, also did not actually outperform it. source: https://kenschutte.com/gzip-knn-paper/ https://kenschutte.com/gzip-knn-paper/