3 ms·
Nah, it takes a mastermind to be creative. The tiny models IME are good at following explicit instructions for data transformations (conforming to a JSON schema
by jazzyjackson 2y ago
Nah, it takes a mastermind to be creative. The tiny models IME are good at following explicit instructions for data transformations (conforming to a JSON schema is especially helpful) but I wouldn't expect one to solve a problem I haven't already solved myself like how I use the .6T full size models.
- EE84M3i 2y agoI thought conforming to a JSON schema was a solved problem for even the most garbage models by restricting the tokens it can generate?
- jazzyjackson 2y agoYes that's what I mean, with a well described task and a JSON schema, the tiny models are suitable (though still hallucinatory - even llama3 7B was making up phone numbers when I tasked it with extracting contact details from email signature blocks) I was pushing back against the parent's notion that tiny models would serve general purpose needs.