3 ms·

Funnily enough, there is a mathematical link between data compression and AGI [1]. I believe a paper circulated some time ago that compared gpt2 to gzip, with i

Funnily enough, there is a mathematical link between data compression and AGI [1]. I believe a paper circulated some time ago that compared gpt2 to gzip, with interesting results. [1] https://en.wikipedia.org/wiki/AIXI https://en.wikipedia.org/wiki/AIXI

TeMPOraL 2y ago
More than that, in general, understanding and compression seem to be fundamentally the same thing.
- cootsnuck 2y ago
  I would say understanding requires compression not that it equates to it. Probably just semantics though.