4 ms·
Apple makes a ton of sense. They sell hardware (and services for that hardware). It would make sense that they want to commoditize foundation models while at
by jedberg 3y ago
Apple makes a ton of sense. They sell hardware (and services for that hardware). It would make sense that they want to commoditize foundation models while at the same time creating yet another reason to buy their most powerful hardware.
Meta is the real wildcard here. They're betting on "commoditize your compliment" and hoping by making GenAI training nearly free (by doing it for you) that none of their competitors can use GenAI models to gain an advantage over them.
- deleted 3y ago[deleted]
- keepper 3y agoWhy is Meta the wildcard? Meta has the largest track record of open sourcing everything. From hardware (OpenCompute suite of releases ) to pretty much all software ( HHVM, Hack, Buck, etc etc ) that would benefit wider use. Even Meta's ML research has a history of open sourcing everything, hello PyTorch. So Llama is just a continuation
- jedberg 3y agoOnly because all their open source didn't cost them billions to produce. Making a foundation model is at least a billion dollars in just hardware and power. But you're right they do have a good history of open source, and they should get credit for that.
- yunwal 3y agoHistorically, Apple doesn't sell hardware, they sell a combination of software and hardware that are supposedly more tightly integrated than is possible when those things are developed separately. It's interesting and surprising that they would develop and release an open source model.
- bombcar 3y agoApple devices have specialized processors, that while quite powerful, need some custom coding. They don't want to be left behind with a "everyone with an Nvidia GPU can play" world. Open-source is the best counter to that right now.