4 ms·
> Yeah...a "dumb as bricks CPU", which is obviously something frontier llms are demonstrably not. Just as the immense amount of scaffolding around the dumb-as-
by simoncion 2mo ago
> Yeah...a "dumb as bricks CPU", which is obviously something frontier llms are demonstrably not.
Just as the immense amount of scaffolding around the dumb-as-bricks CPU enables extremely sophisticated and useful things to be done with that pile of fused sand and copper, the immense amount of scaffolding around the dumb-as-bricks LLM enables very sophisticated and useful things to be done with that pile of linear algebra.
Don't confuse the infrastructure that makes the stupid bit in the middle actually useful with the stupid bit in the middle.
- famouswaffles 2mo agoLLMs are not the "stupid bit in the middle." They're almost the entire value. LLMs were wildly useful before any sort of scaffolding. They are not "dumb as bricks". They are highly capable, flexible, intelligent prediction machines. The only one confused here is you, and you've still not managed to tell us in an actionable way how exactly CPU scaffolding is relevant here. Tell us, if it's so easy, or make your millions selling it. We're all waiting. I'll give you a hint. CPUs never had to interpret the meaning of arbitrary content in order to do their job, and LLMs do.
- simoncion 2mo ago> [LLMs are] almost the entire value. I agree that without the LLM, the system around it is useless. I also agree that without the CPU, the system around that is useless. > LLMs are not the "stupid bit in the middle." Both a model and a CPU without their scaffolding are incredibly useless. You don't even get I/O! If you can't get data out of or into the model or CPU, what use is it?