3 ms·
That seems a lot worse than a 2060 SUPER with PyTorch in A1111. https://vladmandic.github.io/sd-extension-system-info/pages/benchmark.html https://vladmandic.g
by dragonwriter 3y ago
That seems a lot worse than a 2060 SUPER with PyTorch in A1111.
https://vladmandic.github.io/sd-extension-system-info/pages/benchmark.html https://vladmandic.github.io/sd-extension-system-info/pages/... (search for 2060 SUPER)
- adrian_b 3y agoThis is not surprising, because the GPU support in GGML is said to be preliminary and it is optimized for being run on CPUs. Seeing the times reported by other people, it seems that using the GPU with GGML, instead of the CPU, still provides a speed improvement, but it is small. Nevertheless, I have appreciated that after following exactly the instructions of this project everything was up and running after a few minutes and it could be tested. Past attempts to install all the environment needed to run such models have required much more work.