4 ms·

Apple realized that 1/OpenAI is no longer the ONLY game in town, and 2/Models != Platform. Maybe, maybe Apple can achieve what they need (Apple Intelligence), w

by bg24 2y ago

Apple realized that 1/OpenAI is no longer the ONLY game in town, and 2/Models != Platform. Maybe, maybe Apple can achieve what they need (Apple Intelligence), while keeping the doors open for multiple models.

MuffinFlavored 2y ago
> Apple realized that 1/OpenAI is no longer the ONLY game in town Who is the other game in town for them?... Meta? Google?
- rgrmrts 2y ago
  Anthropic as well
- mrbungie 2y ago
  No one from the list (also add Anthropic to that list) is SOTA right now, but maybe Apple wants to keep its options open as the gap closes between OAI and the others.
  - xnx 2y ago
    > No one from the list (also add Anthropic to that list) is SOTA right now I don't use OpenAI's products. Is there an area where they are clearly ahead? I thought it was at least a tie in all categories.
    - mrbungie 2y ago
      Last time I checked, o1 did much better in PlanBench that models from other providers indicating better perf in that area [1][2]. Probably that lead will rapidly decay as other players implement similar approaches to "reasoning"/LRMs. [1] https://www.arxiv.org/abs/2409.13373 https://www.arxiv.org/abs/2409.13373 [2] https://x.com/omarsar0/status/1838353480672563581 https://x.com/omarsar0/status/1838353480672563581
  - maeil 2y ago
    o1, which you seem to be referring to, is at best slightly better at specific tasks than Sonnet 3.5 while being completely unviable economically for production use, despite the amount of subsidizing OpenAI has been doing to make them lose a cool $5 billion this year. GPT has barely improved over the last 1.5 years [1]. [1] https://aider.chat/assets/models-over-time.svg https://aider.chat/assets/models-over-time.svg
    - mrbungie 2y ago
      Yeah, I know. I didn't say it was incredibly better in every bench, but there are reasoning and planning benchmarks it does much better (not just slightly) than Sonnet 3.5 and the rest right now, and that still that makes their offering SOTA vs the others, even if its not in terms of cost. I put sources in another sibling comment, and as I said in both comments, I think that gap will close. I don't expect OAI to keep their moat much longer, especially with the people they've lost. PS: I say all of this as a constant critic of OAI: both how they behave and their offerings. But credit where credit is due, I don't see out-of-the-box alternatives to OAI's rlhf'd CoT at any price point right now.

by bg24 2y ago

MuffinFlavored 2y ago

> Apple realized that 1/OpenAI is no longer the ONLY game in town Who is the other game in town for them?... Meta? Google?

rgrmrts 2y ago
Anthropic as well
mrbungie 2y ago
No one from the list (also add Anthropic to that list) is SOTA right now, but maybe Apple wants to keep its options open as the gap closes between OAI and the others.
- xnx 2y ago
  > No one from the list (also add Anthropic to that list) is SOTA right now I don't use OpenAI's products. Is there an area where they are clearly ahead? I thought it was at least a tie in all categories.
  - mrbungie 2y ago
    Last time I checked, o1 did much better in PlanBench that models from other providers indicating better perf in that area [1][2]. Probably that lead will rapidly decay as other players implement similar approaches to "reasoning"/LRMs. [1] https://www.arxiv.org/abs/2409.13373 https://www.arxiv.org/abs/2409.13373 [2] https://x.com/omarsar0/status/1838353480672563581 https://x.com/omarsar0/status/1838353480672563581
- maeil 2y ago
  o1, which you seem to be referring to, is at best slightly better at specific tasks than Sonnet 3.5 while being completely unviable economically for production use, despite the amount of subsidizing OpenAI has been doing to make them lose a cool $5 billion this year. GPT has barely improved over the last 1.5 years [1]. [1] https://aider.chat/assets/models-over-time.svg https://aider.chat/assets/models-over-time.svg
  - mrbungie 2y ago
    Yeah, I know. I didn't say it was incredibly better in every bench, but there are reasoning and planning benchmarks it does much better (not just slightly) than Sonnet 3.5 and the rest right now, and that still that makes their offering SOTA vs the others, even if its not in terms of cost. I put sources in another sibling comment, and as I said in both comments, I think that gap will close. I don't expect OAI to keep their moat much longer, especially with the people they've lost. PS: I say all of this as a constant critic of OAI: both how they behave and their offerings. But credit where credit is due, I don't see out-of-the-box alternatives to OAI's rlhf'd CoT at any price point right now.