3 ms·
How reliable are these benchmarks?
by photon_collider 3y ago
How reliable are these benchmarks?
- ilaksh 3y agoI think the trick is that they are just comparing to other tiny models. None of the little models, including this one, are comparable to the performance of the larger models for any significant coding problem. I think what these are useful for is mostly giving people hints inside of a code editor. Occasionally filling in the blank.