4 ms·
> Here's something most developers overlook: if an LLM has a 2% JSON defect rate, and Response Healing drops that to 1%, you haven't just made a 1% improvement.
by top1aibooster 10mo ago
> Here's something most developers overlook: if an LLM has a 2% JSON defect rate, and Response Healing drops that to 1%, you haven't just made a 1% improvement. You've cut your defects, bugs, and support tickets in half.
If part of my system can't even manage to output JSON reliably, it needs way more "healing" than syntax munging. This comes across as naive.
- arm32 10mo agoBut, but, you've just cut your defects, bugs, and support tickets in half!
- Dylan16807 10mo agoPlus, that claim isn't even true. A 1% and 2% JSON defect rate are going to annoy a similar amount of people into filing bugs and tickets.
- fhcuvyxu 10mo ago1% fail rate on API requests is horrifyingly embarrassing.
- 0cf8612b2e1e 10mo agoSounds like we are twice as close to AGI!
- Cheer2171 10mo ago[dead]
- 01HNNWZ0MV43FF 10mo ago"it's not just X, it's Y" Don't you worry about Planet Express, let me worry about blank.
- Spivak 10mo agoModel itself can't output JSON reliably. It's on you building a system around the model to make sure it either returns correct output or errors which is trivial to do.
- spwack 10mo ago[dead]