6 ms·
There are plenty of LLM benchmarks that are used to test performance, some of them are: * Winogrande * BoolQ * PIQA * SIQA * HellaSwag etc...
by imranq 3y ago
There are plenty of LLM benchmarks that are used to test performance, some of them are:
* Winogrande
* BoolQ
* PIQA
* SIQA
* HellaSwag
etc...
- junrushao1994 3y agoWould be nice if anyone could help us benchmark! Our primary focus though is not model performance, but to demonstrate the capability that TVM Unity generates code targeting WebGPU and allows them to run with client GPUs :-)