3 ms·
This assumes that the benchmarks are representative of real usage scenarios. I'm not saying that there is bad faith, but that benchmarking is really hard in the
by haolez 1y ago
This assumes that the benchmarks are representative of real usage scenarios. I'm not saying that there is bad faith, but that benchmarking is really hard in the context of LLMs.
- incomingpain 1y ago>This assumes that the benchmarks are representative of real usage scenarios. I'm not saying that there is bad faith, but that benchmarking is really hard in the context of LLMs. It's a fair point, but the conclusion is 'i dont know' I could assume that it gets better because it'll keep to simpler code.