3 ms·

I was not expecting for Apple to be releasing any open source generative ai product. So the big players in the download it yourself gang are Meta & Apple? I don

I was not expecting for Apple to be releasing any open source generative ai product. So the big players in the download it yourself gang are Meta & Apple? I don't think anyone would have taken that bet when OpenAI blew up.

jedberg 3y ago
Apple makes a ton of sense. They sell hardware (and services for that hardware). It would make sense that they want to commoditize foundation models while at the same time creating yet another reason to buy their most powerful hardware. Meta is the real wildcard here. They're betting on "commoditize your compliment" and hoping by making GenAI training nearly free (by doing it for you) that none of their competitors can use GenAI models to gain an advantage over them.
- deleted 3y ago
  [deleted]
- keepper 3y ago
  Why is Meta the wildcard? Meta has the largest track record of open sourcing everything. From hardware (OpenCompute suite of releases ) to pretty much all software ( HHVM, Hack, Buck, etc etc ) that would benefit wider use. Even Meta's ML research has a history of open sourcing everything, hello PyTorch. So Llama is just a continuation
  - jedberg 3y ago
    Only because all their open source didn't cost them billions to produce. Making a foundation model is at least a billion dollars in just hardware and power. But you're right they do have a good history of open source, and they should get credit for that.
- yunwal 3y ago
  Historically, Apple doesn't sell hardware, they sell a combination of software and hardware that are supposedly more tightly integrated than is possible when those things are developed separately. It's interesting and surprising that they would develop and release an open source model.
  - bombcar 3y ago
    Apple devices have specialized processors, that while quite powerful, need some custom coding. They don't want to be left behind with a "everyone with an Nvidia GPU can play" world. Open-source is the best counter to that right now.
frankfrank13 3y ago
They do have quite a few open source projects, I don't think they would open source something like LLama, but something on this scale makes sense

jedberg 3y ago

Apple makes a ton of sense. They sell hardware (and services for that hardware). It would make sense that they want to commoditize foundation models while at the same time creating yet another reason to buy their most powerful hardware. Meta is the real wildcard here. They're betting on "commoditize your compliment" and hoping by making GenAI training nearly free (by doing it for you) that none of their competitors can use GenAI models to gain an advantage over them.

deleted 3y ago
[deleted]
keepper 3y ago
Why is Meta the wildcard? Meta has the largest track record of open sourcing everything. From hardware (OpenCompute suite of releases ) to pretty much all software ( HHVM, Hack, Buck, etc etc ) that would benefit wider use. Even Meta's ML research has a history of open sourcing everything, hello PyTorch. So Llama is just a continuation
- jedberg 3y ago
  Only because all their open source didn't cost them billions to produce. Making a foundation model is at least a billion dollars in just hardware and power. But you're right they do have a good history of open source, and they should get credit for that.
yunwal 3y ago
Historically, Apple doesn't sell hardware, they sell a combination of software and hardware that are supposedly more tightly integrated than is possible when those things are developed separately. It's interesting and surprising that they would develop and release an open source model.
- bombcar 3y ago
  Apple devices have specialized processors, that while quite powerful, need some custom coding. They don't want to be left behind with a "everyone with an Nvidia GPU can play" world. Open-source is the best counter to that right now.

frankfrank13 3y ago

They do have quite a few open source projects, I don't think they would open source something like LLama, but something on this scale makes sense