3 ms·

Maybe open AI and Anthropic could just license their models to run on your own hardware. So a fixed cost instead of per token pricing or subscription with limit

• SSLy 29d ago
  But think about the safety!! (/s)
• phoghed 29d ago
  Fixed costs are already available via PTU reservation and afaik most serious enterprise projects are using this
• apefulsin 29d ago
  This would require them to give you a copy of their models, which would quickly be leaked on the internet, and they know that, so it won't happen.
  • Mkengin 29d ago
    Google is already doing that since last year and the models where never leaked, so I don't think that would even be a problem. https://cloud.google.com/blog/topics/hybrid-cloud/gemini-is-now-available-anywhere https://cloud.google.com/blog/topics/hybrid-cloud/gemini-is-...
• nutjob2 29d ago
  This is the future, because the market will demand it. I think there will be separate and huge markets for models, hardware and compute. That will maximize competition and innovation. Why? Because even Blind Freddy can see the huge usefulness and power of these (and future non-LLM) models and no-one in their right mind is interested in becoming OpenAI's or Anthropic's bitch. Those companies have tickets on themselves. Given the recent behavior of tech companies and the US administration, no one trusts either anymore.