3 ms·

This pushed our small team to try Azure instance of GPT3.5 - wow 20 times faster. API does not fail to respond to server requests as we found oh so often on the

This pushed our small team to try Azure instance of GPT3.5 - wow 20 times faster. API does not fail to respond to server requests as we found oh so often on the OpenAI API. We now have something fast enough and stable enough to actually use. Pricing is higher, but my goodness, it actually works.

moontear 3y ago
Pricing higher is funny because OpenAI fully runs on Azure.
- 7734128 3y ago
  It's a bit different to have an instance always prepared for your use and to use a shared infrastructure. The latter could pretty much always expect at least a few percent use, which would reduce price.
- vegarab 3y ago
  Why? The Azure API comes with an SLA and support.
raverbashing 3y ago
As much as I'm sure people on OpenAI are good, they're focused on the research and math of the thing, but lack in Ops experience (though to be honest I think Azure API was flaky yesterday)
- danielbln 3y ago
  Considering the complexities involved and the outrageous amount of MAUs OpenAI has on their platform and yet them north of 99.8% uptime (ok, November was worse with 99,20%), saying they lack Ops experience is ludicrous.
  - raverbashing 3y ago
    Oh I'm sure they have competent people But compared to FB, MS, Google etc they are probably still behind (both in infrastructure and maturity)
quickthrower2 3y ago
Hows everyone finding Azure? I’m an Azure bread and butter user but I am sure people mostly on AWS are having fun with Azures CLIs APIs Portal etc. because it is going to be a lot different and unfamiliar. Also egress/ingress costs although mostly the AI costs would far exceed that anyway.