3 ms·

Which model? Or how many active parameters?

• _whiteCaps_ 2mo ago
  Llama 3.1 8B model
  • dumberquestions 2mo ago
    So this demo is around 90 times faster than typical speeds for the same model at openrouter, and around 30 times faster than the absolute fastest option available (Groq).
    • anthonypasq 2mo ago
      im assuming energy expenditure is substantially lower as well
    • mdp2021 2mo ago
      https://taalas.com/h-content/uploads/2026/02/graph.png https://taalas.com/h-content/uploads/2026/02/graph.png
      • Gander5739 2mo ago
        https://xkcd.com/1162/ https://xkcd.com/1162/
• deleted 2mo ago
  [deleted]