2 ms·
> Language models are commodities and the weights are free That's like saying chips are a commodity. You can buy from Intel, or AMD. Why bother making somethin
by bitpush 1y ago
> Language models are commodities and the weights are free
That's like saying chips are a commodity. You can buy from Intel, or AMD. Why bother making something yourself. And yet, Apple has proven that unless you vertically integrate you're not going to differentiate.
- msgodel 1y agoEh. Apple's chips are good but not exactly game changing. At the end of the day if they're doing anything useful they still run the same software everyone else's do with roughly the same performance. It's a great analogy for the situation with language models. Can you get a slight edge with the particular RL tuning on some models? Sure. Does it actually result in qualitative changes in what the model can do? No not really, all of them can do MCP, all of them still hallucinate etc.