4 ms·
Llama 3.1 8B model
by _whiteCaps_ 2mo ago
Llama 3.1 8B model
- dumberquestions 2mo agoSo this demo is around 90 times faster than typical speeds for the same model at openrouter, and around 30 times faster than the absolute fastest option available (Groq).
- anthonypasq 2mo agoim assuming energy expenditure is substantially lower as well
- mdp2021 2mo agohttps://taalas.com/h-content/uploads/2026/02/graph.png https://taalas.com/h-content/uploads/2026/02/graph.png
- Gander5739 2mo agohttps://xkcd.com/1162/ https://xkcd.com/1162/