3 ms·

Yeah it's a bit ambiguous, but in any case I'd think simply using that idle capacity to generate tokens would be more valuable than finding a basically meaningl

by redox99 12d ago

Yeah it's a bit ambiguous, but in any case I'd think simply using that idle capacity to generate tokens would be more valuable than finding a basically meaningless number.

treszkai 12d ago
Except customer demand doesn't follow the fixed supply of GPU compute that any company has, so they either a) rent compute on demand, b) sell their excess compute, c) let it sit idle and maybe an employee claims it.
- redox99 12d ago
  I mean tokens for internal use.