4 ms·

I think you are missing the "idle capacity" information. The GPUs are not running 24/7, there may be minutes of time in a day where there is not an active job r

I think you are missing the "idle capacity" information. The GPUs are not running 24/7, there may be minutes of time in a day where there is not an active job running, the author simply located these inactive GPUs during the downtime and utilized it until another job was queued.

redox99 15d ago
Yeah it's a bit ambiguous, but in any case I'd think simply using that idle capacity to generate tokens would be more valuable than finding a basically meaningless number.
- treszkai 15d ago
  Except customer demand doesn't follow the fixed supply of GPU compute that any company has, so they either a) rent compute on demand, b) sell their excess compute, c) let it sit idle and maybe an employee claims it.
  - redox99 14d ago
    I mean tokens for internal use.