5 ms·
It depends on the model you run but generally speaking you want an NVIDIA GPU of some substance. I’d say like a 3060 at minimum. CPU inference is incredibly sl
by gymbeaux 2y ago
It depends on the model you run but generally speaking you want an NVIDIA GPU of some substance. I’d say like a 3060 at minimum.
CPU inference is incredibly slow versus my RTX 3090, but technically it will work.