3 ms·

> Looking at how well current GPTs are able to write calls to external APIs Are you talking about the behavior of ChatGPT constantly inventing API parameters t

> Looking at how well current GPTs are able to write calls to external APIs Are you talking about the behavior of ChatGPT constantly inventing API parameters that would be kind of useful to solve the task at hand, but which unfortunately aren't part of the external API? I would say that understanding that there's a difference between your own code, where you have full freedom to design your contracts, and "code of others" where you have to adhere to some already-defined contract, would be an absolute minimum bar that must be passed in order to call someone (or something) proficient at writing calls to external APIs.

throwaway4aday 4y ago
davinci has been pretty good about using APIs that I've shown it, I can certainly see it hallucinating parameters but I also misremember interfaces. It seems that you could easily solve that a number of ways e.g. analysis, tests, submitting the code along with the spec and a prompt that asks for bug checking with the temperature set to 0. Just because you can't one shot a perfect completion every time with 0 engineering investment doesn't mean you can't use this technology to build some cool things.