3 ms·
I thought conforming to a JSON schema was a solved problem for even the most garbage models by restricting the tokens it can generate?
by EE84M3i 2y ago
I thought conforming to a JSON schema was a solved problem for even the most garbage models by restricting the tokens it can generate?
- jazzyjackson 2y agoYes that's what I mean, with a well described task and a JSON schema, the tiny models are suitable (though still hallucinatory - even llama3 7B was making up phone numbers when I tasked it with extracting contact details from email signature blocks) I was pushing back against the parent's notion that tiny models would serve general purpose needs.