3 ms·Not to mention latencyby azinman2 2y agoNot to mention latencydisgruntledphd2 2y agoAnd grounding for the model. Smaller models with tend to hallucinate a little less (anecdotally).