12 ms·

Microsoft is invested in OpenAI. Have they released any open weight models themselves? Apple is similarly partnering with OpenAI. Google has released nerfed v

Microsoft is invested in OpenAI. Have they released any open weight models themselves? Apple is similarly partnering with OpenAI. Google has released nerfed versions of its Gemini models (Gemma 2B and Gemma 7B). It seems the only company truly setting an example for open weights is Meta. Hopefully the other companies realize that it’s in their best interest to do the same (as it seems Google is begrudgingly realizing with its nerfed releases). Eventually open weights will win, and if OpenAI (the most ironically named company) continues to rely on closed models as its moat, it will lose.

roywiggins 2y ago
> Microsoft is invested in OpenAI. Have they released any open weight models themselves? Phi-3? https://azure.microsoft.com/en-us/products/phi-3 https://azure.microsoft.com/en-us/products/phi-3
lsaferite 2y ago
> Microsoft is invested in OpenAI. Have they released any open weight models themselves? Do the Phi series models not count?
- chatmasta 2y ago
  Sure they do. I was genuinely asking.
  - Onawa 2y ago
    Well then yes, I would definitely say Phi. And on top of that Microsoft has been releasing a ton of the tooling surrounding LLMs and AI as well, including Semantic Kernel.
deleted 2y ago
[deleted]
kkielhofner 2y ago
“AI” is much more than LLMs… Not only have all three of these companies released LLM model weights, Google and Microsoft especially have released nearly countless model architectures, weights, evaluation/training/inference/etc frameworks, toolkits, etc across an extremely wide spectrum.
- rvnx 2y ago
  They mainly offer open tooling to help you adopt their closed-source tech (e.g. RAG frameworks) but you don't get the freedom to do what you want with the model (which is the core). At some point, these big companies may even want to put more regulation or restrictions on their open-weights / open-source competitors. "Hey this is not validated for safety, you can use only Gemini"
  - talldayo 2y ago
    They don't? Microsoft and Google both promote Open Source inferencing frameworks, and while both also have proprietary products I think it's completely dishonest to say they "mainly" support them. ONNX and Tensorflow have been supported longer and more productively than any of the closed-source AI frameworks Google or Microsoft offer.
    - rvnx 2y ago
      Let’s see what the future holds. I’m feeling that the next step will be for regulators to start restricting more and more open-source/open-weight LLMs (and their equivalent Diffusion models), in the name of safety. Perhaps requiring certifications in professional use for example. I see it as a happy coincidence for these large players if this is the case, because only folks with large pockets and the right thoughts will be able to get certified.
      - talldayo 2y ago
        You are currently posting in a thread where the root article is a press release detailing why open weight LLMs aren't going to get restricted by the incumbents. I also have seen no indication that any president-hopefuls intend to regulate the tech either. There are no demonstrated dangers yet, the value of exporting this digital snake-oil far outweighs the cost of other people asking ChatGPT how to make a fertilizer bomb.
apwell23 2y ago
> Apple is similarly partnering with OpenAI. I think this is too generous of an interpretation for their deal.

roywiggins 2y ago

> Microsoft is invested in OpenAI. Have they released any open weight models themselves? Phi-3? https://azure.microsoft.com/en-us/products/phi-3 https://azure.microsoft.com/en-us/products/phi-3

lsaferite 2y ago

> Microsoft is invested in OpenAI. Have they released any open weight models themselves? Do the Phi series models not count?

chatmasta 2y ago
Sure they do. I was genuinely asking.
- Onawa 2y ago
  Well then yes, I would definitely say Phi. And on top of that Microsoft has been releasing a ton of the tooling surrounding LLMs and AI as well, including Semantic Kernel.

deleted 2y ago

[deleted]

kkielhofner 2y ago

“AI” is much more than LLMs… Not only have all three of these companies released LLM model weights, Google and Microsoft especially have released nearly countless model architectures, weights, evaluation/training/inference/etc frameworks, toolkits, etc across an extremely wide spectrum.

rvnx 2y ago
They mainly offer open tooling to help you adopt their closed-source tech (e.g. RAG frameworks) but you don't get the freedom to do what you want with the model (which is the core). At some point, these big companies may even want to put more regulation or restrictions on their open-weights / open-source competitors. "Hey this is not validated for safety, you can use only Gemini"
- talldayo 2y ago
  They don't? Microsoft and Google both promote Open Source inferencing frameworks, and while both also have proprietary products I think it's completely dishonest to say they "mainly" support them. ONNX and Tensorflow have been supported longer and more productively than any of the closed-source AI frameworks Google or Microsoft offer.
  - rvnx 2y ago
    Let’s see what the future holds. I’m feeling that the next step will be for regulators to start restricting more and more open-source/open-weight LLMs (and their equivalent Diffusion models), in the name of safety. Perhaps requiring certifications in professional use for example. I see it as a happy coincidence for these large players if this is the case, because only folks with large pockets and the right thoughts will be able to get certified.
    - talldayo 2y ago
      You are currently posting in a thread where the root article is a press release detailing why open weight LLMs aren't going to get restricted by the incumbents. I also have seen no indication that any president-hopefuls intend to regulate the tech either. There are no demonstrated dangers yet, the value of exporting this digital snake-oil far outweighs the cost of other people asking ChatGPT how to make a fertilizer bomb.

apwell23 2y ago

> Apple is similarly partnering with OpenAI. I think this is too generous of an interpretation for their deal.