3 ms·
That's not how you're supposed to use LLMs. You shouldn't expect a tiny little local model to know random facts about every obscure consumer product on earth. T
by nvme0n1p1 17d ago
That's not how you're supposed to use LLMs. You shouldn't expect a tiny little local model to know random facts about every obscure consumer product on earth. That's the job of tool calling. At best a model of this size is just giving you a random guess.
You're basically saying "I tried rolling these dice one time, the green dice rolled a 6 and the blue dice rolled a 1, so green dice are better"
- serf 17d agoagreed. a niche knowledge callout is about the worst benchmark one can give a smaller model. smaller models are attempting to distill the useful methodologies, not the license plate number of an obscure extras car on Magnum PI. that said I wonder if there is a small 'trivia' model out there. Seems like the kinda thing Google would tackle.
- npodbielski 17d agoWhich was not he point because I was testing their solution for MPT and it was just funny addition. But of course in internet you always will find some 'well akchually' person straight from the meme.