3 ms·

Nor do they have to. Inference from different users is batched together.

• catmanjan 8mo ago
  Ok? Even if they're batched? Grid energy is batched too