3 ms·
They do benefit from batching; up to a 50% performance improvement, in my experience. That might seem small compared to LLMs, but it isn't small in absolute te
by Filligree 3y ago
They do benefit from batching; up to a 50% performance improvement, in my experience.
That might seem small compared to LLMs, but it isn't small in absolute terms.
- ls612 3y agoI got a 2x jump on my 4090 from batching SDXL.