2 ms·
Naturally, but you need that for GPUs as well, no? What is the actual difference when running, when measured per token generated?
by int_19h 3y ago
Naturally, but you need that for GPUs as well, no? What is the actual difference when running, when measured per token generated?