yo-cuddles

3 ms·

1.
by yo-cuddles 2y ago
It really doesn't lol. Those laws are like Moore's law, an observation rather than something Fundamental like laws in physics The scaling has been plateauing, and half that equation is quality training data which is totally out at
2.
by yo-cuddles 2y ago
KIND OF if you've tried to get o1 to give you outputs in a specific format, it often just tells you to take a hike. It's a stubborn model, which implies a lot This is speculation, but it seems that the main benefit of reasoning mo
3.
by yo-cuddles 2y ago
Pending me getting an understanding of what those advances were, maybe? But making things smaller is different than making them more powerful, those are different categories of advancement. If you've noticed, models of varying sizes se
4.
by yo-cuddles 2y ago
The age of pre-training is basically over, I think everyone acknowledged this and it's not to do with not having a big enough cluster. The bull argument on AI is that inference time scaling will pull us to the next step Except o3 bench
5.
by yo-cuddles 2y ago
Probably not. If the price of Nvidia is dropping, it's because investors see a world where Nvidia hardware is less valuable, probably because it will be used less. You can't do the distill/magnify cycle like you do with alpha
6.
by yo-cuddles 2y ago
That's the most damning thing: they have no warchest from LLM's, no vast profits to propel them to the next big thing. It HAS to be LLM's to AGI or bust if Openai even has a shot at it's foundational mission. If they don