3 ms·

Bro you are given a state of the art multi million dollar compute for like a couple of cents and you complain about not having it spoonfed to you. You have an

Bro you are given a state of the art multi million dollar compute for like a couple of cents and you complain about not having it spoonfed to you. You have an http api, implement all of this yourself, the devs can't read your mind. You should be able to issue a request and do stuff before reading the response, boom non-blocking. If you can't handle low level, just use threads plus your favourite abstraction? User API auth. Never seen this by an api provider, you are in charge of user auth, what do you even expect here? Do your job, openai isn't supposed to magically solve this for you, you are not a consumer of magical solutions, you are now a provider of them

skywhopper 3y ago
I agree so much but the last line struck me as hilarious given that 90% of the hype around LLM-based AI is explicitly that people do believe it’s magical. People already believe this tech is on the verge of replacing doctors, programmers, writers, actors, accountants, and lawyers. Why shouldn’t they expect the boring stuff like auth pass-thru to be pre-solved? Surely the AI companies can just have their LLM generate the required code, right?
- oezi 3y ago
  Auth-pass thru is impossible/impractical with OpenAI tool API, because there is no way to identify users. Thus even if users log into my website first and I get their OAuth there, I can't associate to their OpenAI session.
oezi 3y ago
OpenAI isn't offering a viable product as it currently stands. This is why we only saw toy usage with the Plugins API and now with tools as part of GPTs. Since OpenAI wants to own the front end of the GPTs there isn't any way to implement the parts which aren't there. About non-blocking: I am asking for their tools API to not block the user from continuing the conversation while my tool works. You seem to be thinking about something else.
- ShamelessC 3y ago
  > About non-blocking: I am asking for their tools API to not block the user from continuing the conversation while my tool works. You seem to be thinking about something else. To be fair, that was very ambiguous (talking about API’s and non-blocking IO) and their initial assumption was the same as mine (and quite reasonable).

skywhopper 3y ago

I agree so much but the last line struck me as hilarious given that 90% of the hype around LLM-based AI is explicitly that people do believe it’s magical. People already believe this tech is on the verge of replacing doctors, programmers, writers, actors, accountants, and lawyers. Why shouldn’t they expect the boring stuff like auth pass-thru to be pre-solved? Surely the AI companies can just have their LLM generate the required code, right?

oezi 3y ago
Auth-pass thru is impossible/impractical with OpenAI tool API, because there is no way to identify users. Thus even if users log into my website first and I get their OAuth there, I can't associate to their OpenAI session.

oezi 3y ago

OpenAI isn't offering a viable product as it currently stands. This is why we only saw toy usage with the Plugins API and now with tools as part of GPTs. Since OpenAI wants to own the front end of the GPTs there isn't any way to implement the parts which aren't there. About non-blocking: I am asking for their tools API to not block the user from continuing the conversation while my tool works. You seem to be thinking about something else.

ShamelessC 3y ago
> About non-blocking: I am asking for their tools API to not block the user from continuing the conversation while my tool works. You seem to be thinking about something else. To be fair, that was very ambiguous (talking about API’s and non-blocking IO) and their initial assumption was the same as mine (and quite reasonable).