3 ms·

You need computers for all of them and megawatts of power, power supplies, cooling, and power distribution.

• int_19h 3y ago
  Naturally, but you need that for GPUs as well, no? What is the actual difference when running, when measured per token generated?