4 ms·
So, it's a thing that appends "please format your response as the following JSON" to the prompt", then validates the actual response against the schema, all in
by mahalex 3y ago
So, it's a thing that appends "please format your response as the following JSON" to the prompt", then validates the actual response against the schema, all in a "while (true)" loop (literally) until it succeeds. This unbelievable achievement is a work of seven people (authors of the blog post).
Honestly, this is getting beyond embarrassing. How is this the world we live in?
- siva7 3y agoOne of the authors is Anders Hejlsberg, the guy behind c# and delphi
- mahalex 3y agoThat’s what makes it even more embarrassing.
- rob74 3y agoI think he's probably more of an author in the way that the leader of a research team is always credited on any paper by the team, even if he didn't personally do any actual work on it? Anyway, TIL that Hejlsberg is also involved with TypeScript...
- jlnho 3y agoIt's because not everyone can be as gifted as you. I think the (arguably very prototypical) implementation is not what's interesting here. It's the concept itself. Natural language may soon become the default interface for most of the computing people do on a day to day basis, and tools like these will make it easier to create new applications in this space.
- lsh123 3y agoHm... so how do we know that the actual values in the produced json are correct???
- mahalex 3y agoAs with anything output by “AI”: you don’t.
- TeeWEE 3y agoYeah it’s basically a retry loop. I’m curious about the average response time and the worst case amount of iterations. At best, all these “retry until successfully” are just hacks to bridge the formal world with the stochastic. It’s just useless without some stats on how it performs. And even if it conforms. Your not sure the data makes sense. Probably .. but exactly that probably I would not recommend using this in production.