4 ms·
This reminds of the joke in physics, in which theoretical particle physicists told experimental physicists, over and over again, "trust me bro, standard model w
by TwoFerMaggie 2y ago
This reminds of the joke in physics, in which theoretical particle physicists told experimental physicists, over and over again, "trust me bro, standard model will be proved at 10x eV, we just need a bigger collider bro" after another world's biggest collider is built.
Wondering if we are in a similar position with "trust me bro AGI will be achieved with 10x more GPUs".
- vonneumannstan 2y agoThe difference is the AI researchers have clear plots showing capabilities scaling with GPUs and there's not a sign that it is flattening so they actually have a case for saying that AGI is possible at N GPUs.
- segasaturn 2y agoSauce? How do you even measure "capabilities" in that regard, just writing answers to standard tests? Because being able to ace a test doesn't mean it's AGI, it means its good at taking standard tests.
- vonneumannstan 2y agoThis is the canonical paper. Nothing I've seen seems to indicate the curves are flattening, you can ask "scaling what" but the trend is clear. https://arxiv.org/pdf/2001.08361 https://arxiv.org/pdf/2001.08361