3 ms·

tokens definitely measure compute.

• bcjdjsndon 4mo ago
  You can ask it to verbatim produce training data and that takes very little compute for a lot of output tokens
  • cyanydeez 4mo ago
    i dont think you understand how these models operate.
    • bcjdjsndon 4mo ago
      You can burn kilowatts generating 10 tokens, and conversely produce millions of tokens burning very few watts. You're comment is horse shit