3 ms·
> I'm utterly shocked at the article saying GPU inference (PyTorch/Transformers)isn't working Are you shocked because that isn't your experience? From the art
by jasonjmcghee 1y ago
> I'm utterly shocked at the article saying GPU inference (PyTorch/Transformers)isn't working
Are you shocked because that isn't your experience?
From the article it sounds like ollama runs cpu inference not GPU inference. Is that the case for you?