3 ms·

It’s essentially prompt engineering as a service with some basic quality-control features thrown in. Sure, your engineers could implement it themselves, but do

• verdverm 3y ago
  the quality of the prompt does not look that good from my experience reaching flexible structured output based on a schema There are other questionable decisions and a valuable use of engineering time is indeed to evaluate candidate abstractions and think about the long-term cost of adopting them. In this case, it does not seem like it saves that much effort and in the long run means a lot of important LLM knobs are out of your control. Not a good tradeoff