3 ms·

Dear god does it really? That’s very funny.

• wiseowise 1y ago
  Why are you surprised? It’s a computational thing, after all.
  • BriggyDwiggs42 1y ago
    It’s not that crazy, just the architecture of differently quantized models and so on that you’d need to do that is impressive considering.
    • layer8 1y ago
      The models are the same, it's the surrounding processing like "thinking" iterations that are adjusted.
      • BriggyDwiggs42 1y ago
        That only works for LRMs no? Not traditional LLM inference.