6 ms·
Tip for builders: you can use the GPT APIs on Microsoft Azure. Managed reliably, nobody's quitting, no drama. Same APIs, just with better controls, global avail
by intellectronica 3y ago
Tip for builders: you can use the GPT APIs on Microsoft Azure. Managed reliably, nobody's quitting, no drama. Same APIs, just with better controls, global availability, and a very stable, reliable, and trustworthy provider.
(disclosure: I work at Azure, but this is just my own observation).
- Xenoamorphous 3y agoGPT on Azure has become incredibly slow for us in the past few weeks.
- _boffin_ 3y agoQuestion: how difficult is it to get that no retention waiver on prompts and responses?
- intellectronica 3y agoNot difficult. I've not heard of anyone who asked and _didn't_ get the waiver. It's just a responsible stop-gap in case a user does something questionable or dangerous.
- apstls 3y agoThe waiver still allows for logging of prompts for the specific purpose of abuse monitoring for some limited retention period, right? How difficult is it to have this waived as well?
- haldujai 3y agoI work in academia and with somewhat protected data so YMMV but it wasn't hard for me at all (I just filled out the form and MS approved it).
- mrtksn 3y agoHow the same? Does it have the new Assistant API too?
- intellectronica 3y agoBasically, yes (there are some variations but same functionality, and much more).
- mlindner 3y agoI don't understand what point you're trying to make. Yes Microsoft uses OpenAI APIs. What is the point you're trying to make beyond that? It's still OpenAI software.
- reissbaker 3y agoMicrosoft doesn't "use" the APIs, they host them on their own servers and have a license to do so and re-license to Azure users. If something goes wrong with OpenAI (given that it sounds like many key employees are leaving), Azure will stay up and you can keep using the APIs from MS.
- rob74 3y agoOr, to say it another way, they are cooperating with OpenAI - OpenAI uses Microsoft's cloud services, and Microsoft incorporates OpenAI's products in its own offerings. But the worries people have are not about OpenAI's products suddenly vanishing, it's about the turmoil at OpenAI affecting the future of those products. Actually the exodus of talent from OpenAI may turn out to be beneficial for the development of AI by increasing competition - however it will certainly go against the stated goal of the board for firing Altman, which was basically keeping the development under control.
- deeringc 3y agoThat may provide short term stability, but medium term (which in this field is a few months) how will Azure's offering move forward if OpenAI is in such crisis? I guess it really comes down to OpenAI's ability to continue without Altman and Co. I don't believe that Microsoft's license allows them to independently develop the models? Wouldn't this become a stale fork pretty quickly while the rest of the industry moves on (llama2 etc ..)?
- reissbaker 3y agoI agree that medium term is up in the air and highly dependent on what happens next. If many OAI employees defect to Sam's new company, maybe that becomes the thing everyone migrates to...
- zer00eyz 3y agoYou want me to trust M$ in all this? Embrace, extend, extinguish. Fellow nerds, you really need to go into work on Monday and have a hard chat with your C levels and legal (Because IANAL). The question is: Who owns the output of LLM/AI/ML tooling? I will give you a hint, it's not you. Do you need to copyright what a CS agent says, no, you want them on script as much as possible. An LLM parroting your training data is a good thing (assuming a human wrote it). Do you want an LLM writing code, or copy for your product, or a song for your next corporate sing along (Where did you go old IBM)? No you dont, because it's likely going straight to the public domain. Depending on what your doing with the tool and how your using it, it might not matter that this is the case (its an internal thing) but M$, or openAI, or whoever your vendor is, having a copy that they are free to use might be very bad...
- irrational 3y agoAlso, you might be given someone else’s proprietary IP, setting yourself up for a lawsuit.
- zer00eyz 3y agoIf I grab something off GitHub, and the license there is GPL, but it was someone else's IP I do have some recourse and for my infraction. In the case of an LLM handing it to me can I sue MS or OpenAI for giving out that IP, or is it on me for not checking first? Is any of this covered in the TOS?
- zabzonk 3y agoa hint - the "M$" thing is not smart or funny, just old.
- lannisterstark 3y ago> Embrace, extend, extinguish. Microsoft hasn't embraced that ideology in close to more than a decade by now. Might be the time to let go of the boomer compulsion.
- ascorbic 3y agoHave I just been transported to Slashdot in 2003? I'm not sure you appreciate how enterprise licence agreements work. Every detail of who owns what will have been spelled out, along with the copyright indemnities for the output.
- jiggawatts 3y agoThe Azure-hosted versions are consistently behind the OpenAI versions. For example, the GPT4 128K-token model is unavailable, and the GPT-4V model is also unavailable.
- laurels-marts 3y agoThis. Very frustrating. Why is Azure behind and when is the gpt-4-turbo version coming?
- intellectronica 3y agoIt's already available globally on Azure as of last week.
- laurels-marts 3y agoOkay you’re correct. Last week when I checked I only saw the Dall-E 3 public preview announcement. Now I checked and the Azure page is updated also with GPT-4 Turbo announcement. Very nice!
- jiggawatts 3y agoThey only have the 8K token version.