3 ms·

If it is for capacity issue, they can just say it. Also cushman is, allegedly, a 12B model. It can be served using much lesser demanding hardware. Honestly, t

If it is for capacity issue, they can just say it. Also cushman is, allegedly, a 12B model. It can be served using much lesser demanding hardware. Honestly, they can just severely reduce the nodes allocate to those models, employing punishing rate limits, instead of announcing such a short noticed retirement, if resources are REALLY the issue.

brookst 4y ago
I don’t think they owe you an explanation. And resources aren’t just A100’s. They have engineers maintaining those older models, and support staff answering questions, and so on. OpenAI has found themselves at the center of a gold rush. I don’t blame them for not wanting to operate silver mines, and I don’t expect them to ask my permission or justify themselves to me. (I will be impacted by the codex shutdown. It’s fine. If I wanted to be in a perfectly stable space I’d go support cobol banking applications)
garblegarble 4y ago
If you're trying to convince people to replace humans with your tech then I could see a business not wanting to appear like they're struggling with demand (although, like you I don't think that's the right choice). Like the sibling comment said, it could also be limited by developer capacity - they reportedly have 350 employees (excluding contractors helping with training), with that elite size you wouldn't want to be supporting a large set of different clusters.
- varenc 4y ago
  Riffing on that a bit, I just don't get the sense OpenAI wants to be in the business of hosting mission critical APIs for Fortune 500 companies. To your point, running AWS level services is an entirely different business that doesn't make sense for OpenAI's relatively small team. If you need rock solid stability and scale, OpenAI and Microsoft would probably rather have you just use "Azure OpenAI" services, which is still hosting Codex: https://learn.microsoft.com/en-us/azure/cognitive-services/openai/how-to/work-with-code https://learn.microsoft.com/en-us/azure/cognitive-services/o... Reading between the lines, I think OpenAI is signaling that if you want a more mature and stable product, go with Azure. If you want the latest cutting edge, and don't mind a little instability, keep using OpenAI API's.
  - garblegarble 4y ago
    That's a good take, I hadn't thought about it like that

brookst 4y ago

I don’t think they owe you an explanation. And resources aren’t just A100’s. They have engineers maintaining those older models, and support staff answering questions, and so on. OpenAI has found themselves at the center of a gold rush. I don’t blame them for not wanting to operate silver mines, and I don’t expect them to ask my permission or justify themselves to me. (I will be impacted by the codex shutdown. It’s fine. If I wanted to be in a perfectly stable space I’d go support cobol banking applications)

garblegarble 4y ago

If you're trying to convince people to replace humans with your tech then I could see a business not wanting to appear like they're struggling with demand (although, like you I don't think that's the right choice). Like the sibling comment said, it could also be limited by developer capacity - they reportedly have 350 employees (excluding contractors helping with training), with that elite size you wouldn't want to be supporting a large set of different clusters.

varenc 4y ago
Riffing on that a bit, I just don't get the sense OpenAI wants to be in the business of hosting mission critical APIs for Fortune 500 companies. To your point, running AWS level services is an entirely different business that doesn't make sense for OpenAI's relatively small team. If you need rock solid stability and scale, OpenAI and Microsoft would probably rather have you just use "Azure OpenAI" services, which is still hosting Codex: https://learn.microsoft.com/en-us/azure/cognitive-services/openai/how-to/work-with-code https://learn.microsoft.com/en-us/azure/cognitive-services/o... Reading between the lines, I think OpenAI is signaling that if you want a more mature and stable product, go with Azure. If you want the latest cutting edge, and don't mind a little instability, keep using OpenAI API's.
- garblegarble 4y ago
  That's a good take, I hadn't thought about it like that