5 ms·

Thanks! Why do they not focus on hosting other open models then? I suspect other models will soon catch up with their advantages in faster inference and better

Thanks! Why do they not focus on hosting other open models then? I suspect other models will soon catch up with their advantages in faster inference and better benchmark results. That said, maybe the advantage is aligned interests: they want customers to use their platforms, so they can keep their models open. In contrast, Mistral removed their commitment to open source as they found a potential path to profitability.

Closi 3y ago
Demonstrating you can do it yourself shows a level of investment and commitment to AI in your platform that integrating LLAMA does not. And from a corporate perspective, it means that you have in-house capability to work at the cutting-edge of AI to be prepared for whatever comes next.
- hintymad 3y ago
  > Demonstrating you can do it yourself shows a level of investment and commitment to AI in your platform that integrating LLAMA does not. I buy this argument. It looks that's not what AWS does, though, yet they don't have problem attracting LLM users. Maybe AWS already got enough reputation?
  - zubairshaik 3y ago
    I may be misunderstanding, but doesn't Amazon have it's own models in the form of Amazon Titan[0]? I know they aren't competitive in terms of output quality but surely in terms of cost there can be some use cases for them. [0] https://aws.amazon.com/bedrock/titan/ https://aws.amazon.com/bedrock/titan/
  - rmbyrro 3y ago
    It's easier because 70% of the market already has an AWS account and a sizeable budget allocated to it. The technical team is literally one click away from any AWS service.
theturtletalks 3y ago
Mistral did what many startups are doing now, leveraging open-source to get traction and then doing a rug-pull. Hell, I've seen many startups be open-source, get contributions, get free press, get into YC and before you know it, the repo is gone.
- antupis 3y ago
  Well Databricks is a big company with real cash flow, and Mistral is a startup so there is a kinda big difference here.
richardw 3y ago
They do have a solid focus on doing so, it’s just not exclusive. https://www.databricks.com/product/machine-learning/large-language-models-oss-guidance https://www.databricks.com/product/machine-learning/large-la...
cwyers 3y ago
Commoditize your complements: https://gwern.net/complement https://gwern.net/complement If Databricks makes their money off model serving and doesn't care whose model you use, they are incentivized to help the open models be competitive with the closed models they can't serve.
- youssefabdelm 3y ago
  At this point it's a cliché to share this article, as much as I love gwern lol.
  - sitkack 3y ago
    There is always the lucky 10k.
    - josh-sematic 3y ago
      Today I was one
    - PoignardAzur 3y ago
      For that reference in particular, feels like you should really share the link as well: https://xkcd.com/1053/ https://xkcd.com/1053/
tartrate 3y ago
> Why do they not focus on hosting other open models then? They do host other open models as well (pay-per-token).
- bobbruno 3y ago
  https://docs.databricks.com/en/machine-learning/foundation-models/index.html https://docs.databricks.com/en/machine-learning/foundation-m...

Closi 3y ago

Demonstrating you can do it yourself shows a level of investment and commitment to AI in your platform that integrating LLAMA does not. And from a corporate perspective, it means that you have in-house capability to work at the cutting-edge of AI to be prepared for whatever comes next.

hintymad 3y ago
> Demonstrating you can do it yourself shows a level of investment and commitment to AI in your platform that integrating LLAMA does not. I buy this argument. It looks that's not what AWS does, though, yet they don't have problem attracting LLM users. Maybe AWS already got enough reputation?
- zubairshaik 3y ago
  I may be misunderstanding, but doesn't Amazon have it's own models in the form of Amazon Titan[0]? I know they aren't competitive in terms of output quality but surely in terms of cost there can be some use cases for them. [0] https://aws.amazon.com/bedrock/titan/ https://aws.amazon.com/bedrock/titan/
- rmbyrro 3y ago
  It's easier because 70% of the market already has an AWS account and a sizeable budget allocated to it. The technical team is literally one click away from any AWS service.

theturtletalks 3y ago

Mistral did what many startups are doing now, leveraging open-source to get traction and then doing a rug-pull. Hell, I've seen many startups be open-source, get contributions, get free press, get into YC and before you know it, the repo is gone.

antupis 3y ago
Well Databricks is a big company with real cash flow, and Mistral is a startup so there is a kinda big difference here.

richardw 3y ago

They do have a solid focus on doing so, it’s just not exclusive. https://www.databricks.com/product/machine-learning/large-language-models-oss-guidance https://www.databricks.com/product/machine-learning/large-la...

cwyers 3y ago

Commoditize your complements: https://gwern.net/complement https://gwern.net/complement If Databricks makes their money off model serving and doesn't care whose model you use, they are incentivized to help the open models be competitive with the closed models they can't serve.

youssefabdelm 3y ago
At this point it's a cliché to share this article, as much as I love gwern lol.
- sitkack 3y ago
  There is always the lucky 10k.
  - josh-sematic 3y ago
    Today I was one
  - PoignardAzur 3y ago
    For that reference in particular, feels like you should really share the link as well: https://xkcd.com/1053/ https://xkcd.com/1053/

tartrate 3y ago

> Why do they not focus on hosting other open models then? They do host other open models as well (pay-per-token).

bobbruno 3y ago
https://docs.databricks.com/en/machine-learning/foundation-models/index.html https://docs.databricks.com/en/machine-learning/foundation-m...