6 ms·
The models are already trained… is inference so costly? It’s just a dot product or a matvec or something, right?
by bee_rider 1y ago
The models are already trained… is inference so costly? It’s just a dot product or a matvec or something, right?