3 ms·
Not obvious to me. I thought these AI things required vast amount of GPU power. Or is that for the training part?
by endorphine 3y ago
Not obvious to me. I thought these AI things required vast amount of GPU power. Or is that for the training part?
- ekianjo 3y agoInference works fine on CPUs while a bit slow but fine for a chatbot