3 ms·
I'm not sure how accurate it is but my gut feeling is that the level of meaningful compression is somehow correlated to the level of intelligence behind a model
by ghxst 2y ago
I'm not sure how accurate it is but my gut feeling is that the level of meaningful compression is somehow correlated to the level of intelligence behind a model, I wouldn't be surprised if it ends up being a major focus in general intelligence.
- trash_cat 2y agoThis is the whole premise behind transformers and ChatGPT models and has been discussed by Ilya[0]. [0] https://the-decoder.com/openai-co-founder-explains-the-secret-sauce-behind-unsupervised-learning/ https://the-decoder.com/openai-co-founder-explains-the-secre...