3 ms·
here's an website for a community-ran db on LLM models with details on configs for their token/s: https://inferbench.com/ https://inferbench.com/
by binsquare 8mo ago
here's an website for a community-ran db on LLM models with details on configs for their token/s: https://inferbench.com/ https://inferbench.com/
- mongrelion 8mo agoGreat idea of inferbench (similar to geekbench, etc.) but as of the time of writing, it's got only 83 submissions, which is underwhelming.