5 ms·
Fortunately for OpenAI, they have no SLAs: https://help.openai.com/en/articles/5008641-is-there-an-sla-for-latency-guarantees-on-the-various-engines https://hel
by harveywi 3y ago
Fortunately for OpenAI, they have no SLAs: https://help.openai.com/en/articles/5008641-is-there-an-sla-for-latency-guarantees-on-the-various-engines https://help.openai.com/en/articles/5008641-is-there-an-sla-...
- londons_explore 3y agoI would like to see them offer a decent SLA, but for an increased price. Ie: No SLA: $1 per 1000 requests. With SLA: $2 per 1000 requests. For every minute of downtime, we refund 50% of your daily bill. Obviously they are free to design their systems to make SLA'd requests have priority when there is a capacity crunch or service issues, and that is really what those customers are paying for.
- rad_gruchalski 3y agoSo essentially the price as for without the SLA?
- londons_explore 3y agoNo... 10 minutes downtime means they refund 5 days of typical billing...
- rad_gruchalski 3y agoAh, now I see it, thanks.
- moffkalast 3y agoWould this really be worth it for them when they can just charge everyone the $2 and tell them to pound sand when there's an outage? Not like there's a proper competitor yet.
- londons_explore 3y agoIt's a form of price differentiation. Let the people who have money to pay for a very slightly better service give you more money.
- thih9 3y agoIf this is a hard requirement, then perhaps parametric insurance[1]? I don't have any examples at hand but I've heard about an insurance offer tied to SLAs for external products. [1]: https://en.wikipedia.org/wiki/Parametric_insurance https://en.wikipedia.org/wiki/Parametric_insurance
- bpodgursky 3y agoThis is an absolutely ridiculous ask for a company which is already unable to service the extraordinary demand for their product. AWS itself only credits a month if a service is down for over 30 hours[1] People are going to use OpenAI if it's good. Nobody really cares about SLA if the product is incredible. [1] https://aws.amazon.com/legal/service-level-agreements/?aws-sla-cards.sort-by=item.additionalFields.serviceNameLower&aws-sla-cards.sort-order=asc&awsf.tech-category-filter=*all https://aws.amazon.com/legal/service-level-agreements/?aws-s...
- Qworg 3y agoI hate to talk my own book, but Microsoft does offer SLAs for Azure OpenAI. https://learn.microsoft.com/en-us/azure/cognitive-services/openai/ https://learn.microsoft.com/en-us/azure/cognitive-services/o... Same model availability as well.