4 ms·
> So, should you use GPT to generate your OpenAPI validations? Probably not... yet... I'm looking forward to repeating this experiment with GPT-6, and maybe GPT
by dwohnitmok 4y ago
> So, should you use GPT to generate your OpenAPI validations? Probably not... yet... I'm looking forward to repeating this experiment with GPT-6, and maybe GPT-7 will be able to generate an JSONSchema compiler and replace this library altogether.
from https://github.com/E-xyza/Exonerate/blob/master/bench/reports/gpt-bench.md#conclusions https://github.com/E-xyza/Exonerate/blob/master/bench/report...
(I believe the author is significantly underestimating the pace of progress)
Specific numbers are at https://github.com/E-xyza/Exonerate/blob/master/bench/reports/gpt-bench.md#accuracy-evaluation https://github.com/E-xyza/Exonerate/blob/master/bench/report.... GPT-4 does significantly better.