3 ms·
I don’t think the statement is annoying to some because they see it as a damning indictment of AI. It’s because it’s not literally true. If it were literally t
by WhitneyLand 3y ago
I don’t think the statement is annoying to some because they see it as a damning indictment of AI.
It’s because it’s not literally true. If it were literally true, a zip file would be ChatGPT, but it is not. The paper was named in an intentionally provocative way.
What they really mean is, at the heart of these transformer models, compression is the fundamental principle or goal.
This trend in naming papers has evolved over time. It didn’t always used to be this way.
Some would say a provocative title is thought-provoking and drives a wider interest.
Others would say it’s a research paper and things in it should be literally true.
edit to add direct link to paper:
White-Box Transformers via Sparse Rate Reduction: Compression Is All There Is?
https://arxiv.org/abs/2311.13110 https://arxiv.org/abs/2311.13110