5 ms·

I am at lost. Not fear, just lost. Don't know what to do. Is my investment into their API still worth it? It feels very unstable at this moment.

ThrowawayTestr 3y ago
Microsoft owns it. I honestly can not imagine trying to build a business on an API owned by Microsoft of all companies.
- karmasimida 3y ago
  Would like to elaborate a bit? Though my investment will be still tiny at the moment, but not other multi-modal model on the market right is as good.
  - reissbaker 3y ago
    I actually wouldn't be worried in the short term for exactly this reason. Microsoft has legal access to GPT-4 and is allowed to host and serve it via Azure. If OpenAI somehow tanks its API in the near term, MS is sitting on a gold mine and will make use of that by continuing to serve it. In the long term I am worried, but less worried if Sam and Greg form a competing co to continue to build.
- dewey 3y ago
  What makes you say that? Microsoft seems like one of the more reliable partners to build on compared to Google etc. just for the simple reason that their customers are large businesses and not breaking things for them is in their blood. Just like Windows backwards compatibility.
- jeswin 3y ago
  People have been successfully building on MS APIs for four decades now. I've been for nearly three. What exactly are you saying?
  - ThrowawayTestr 3y ago
    Why would you build a business that Microsoft could sherlock in a second?
- ahepp 3y ago
  Isn't Microsoft famous for their insane API stability and backwards compatibility?
  - isbvhodnvemrwvn 3y ago
    While I think the sentiment is overblown, if you compare Azure to AWS, Azure's stability is like Google's.
  - amai 3y ago
    Microsoft Azure is famous for its insanely bad security: https://karl-voit.at/cloud/ https://karl-voit.at/cloud/
  - wavewrangler 3y ago
    Microsoft is famous for a lack of adoption DESPITE backwards compatibility.
  - andomiz2 3y ago
    No I would not say that at all. Microsoft has gone through how many Desktop APIs for Windows at this point? At least a dozen I'd think.
- zx8080 3y ago
  Do you use github?
padolsey 3y ago
If you're just using their completions/chat API, you're gonna be ok. As an ultimate fallback you can spin up H100s in the cloud and run VLLM atop a high param open model like Llama 70B. Such models will catch up and their param counts will increase.. eventually. But initially expect gpt-3.5-esque performance. VLLM will give you an OpenAI-like REST API atop a range of models. Keep making things :))
- karmasimida 3y ago
  Thx. I will. My current interests mainly lies in benchmarking their vision model. That being said, I might not go further relying on their APIs for something more serious
croes 3y ago
By that logic you could never use a third party API.
abm53 3y ago
If you are building something that is end-user facing that relies on ChatGPT then that was always a huge and risky bet on the future of OpenAI. In addition, it would likely be some time, possibly years, before it would be ready for production. Perhaps recent events have just brought that more clearly into focus for you.

ThrowawayTestr 3y ago

Microsoft owns it. I honestly can not imagine trying to build a business on an API owned by Microsoft of all companies.

karmasimida 3y ago
Would like to elaborate a bit? Though my investment will be still tiny at the moment, but not other multi-modal model on the market right is as good.
- reissbaker 3y ago
  I actually wouldn't be worried in the short term for exactly this reason. Microsoft has legal access to GPT-4 and is allowed to host and serve it via Azure. If OpenAI somehow tanks its API in the near term, MS is sitting on a gold mine and will make use of that by continuing to serve it. In the long term I am worried, but less worried if Sam and Greg form a competing co to continue to build.
dewey 3y ago
What makes you say that? Microsoft seems like one of the more reliable partners to build on compared to Google etc. just for the simple reason that their customers are large businesses and not breaking things for them is in their blood. Just like Windows backwards compatibility.
jeswin 3y ago
People have been successfully building on MS APIs for four decades now. I've been for nearly three. What exactly are you saying?
- ThrowawayTestr 3y ago
  Why would you build a business that Microsoft could sherlock in a second?
ahepp 3y ago
Isn't Microsoft famous for their insane API stability and backwards compatibility?
- isbvhodnvemrwvn 3y ago
  While I think the sentiment is overblown, if you compare Azure to AWS, Azure's stability is like Google's.
- amai 3y ago
  Microsoft Azure is famous for its insanely bad security: https://karl-voit.at/cloud/ https://karl-voit.at/cloud/
- wavewrangler 3y ago
  Microsoft is famous for a lack of adoption DESPITE backwards compatibility.
- andomiz2 3y ago
  No I would not say that at all. Microsoft has gone through how many Desktop APIs for Windows at this point? At least a dozen I'd think.
zx8080 3y ago
Do you use github?

padolsey 3y ago

If you're just using their completions/chat API, you're gonna be ok. As an ultimate fallback you can spin up H100s in the cloud and run VLLM atop a high param open model like Llama 70B. Such models will catch up and their param counts will increase.. eventually. But initially expect gpt-3.5-esque performance. VLLM will give you an OpenAI-like REST API atop a range of models. Keep making things :))

karmasimida 3y ago
Thx. I will. My current interests mainly lies in benchmarking their vision model. That being said, I might not go further relying on their APIs for something more serious

croes 3y ago

By that logic you could never use a third party API.

abm53 3y ago

If you are building something that is end-user facing that relies on ChatGPT then that was always a huge and risky bet on the future of OpenAI. In addition, it would likely be some time, possibly years, before it would be ready for production. Perhaps recent events have just brought that more clearly into focus for you.