2 ms·
They argument of more compression makes the model smarter as argued in the last few minutes, will make you look good and stay in the good graces of Sam Altman,
by belter 2y ago
They argument of more compression makes the model smarter as argued in the last few minutes, will make you look good and stay in the good graces of Sam Altman, and something he can push to his infinite money backers.
But if intelligence were just about compression, then zip files would be "smarter" than humans. The reliance on scaling laws is a symptom that current AI is fundamentally not intelligent, it’s just very good at statistical mimicry. True AGI requires qualitative breakthroughs, not just quantitative scaling.
These researchers have fine-tuned their noses to ignore the stench of overhyped benchmarks