4 ms·
Why this instead of cpu/gpu time?
by jstummbillig 1y ago
Why this instead of cpu/gpu time?
- typpilol 1y agoI'm assuming token count and usage is pretty closely tied
- antiframe 1y agoCPU/GPU time is opaque to me before I send my data, but tokens I can count before I decide to send it. That means I can verify the metering. With CPU time I send the data and then the company says "That cost X CPU units, which is $500".