2 ms·
If the model is small enough to fit in to 10GB of VRAM the GPU can win. But the bigger models are more useful, so that’s what people fixate on.
by seanmcdirmid 8mo ago
If the model is small enough to fit in to 10GB of VRAM the GPU can win.
But the bigger models are more useful, so that’s what people fixate on.