There is this paper that proposed data compression as a way to judge the ability of a LLM to "understand" things correctly, training on older texts and trying t

There is this paper that proposed data compression as a way to judge the ability of a LLM to "understand" things correctly, training on older texts and trying to predict more recent articles: https://ar5iv.labs.arxiv.org/html//2402.00861 https://ar5iv.labs.arxiv.org/html//2402.00861