3 ms·
Does ollama have support for cpu offloading?
by throwaway314155 1y ago
Does ollama have support for cpu offloading?
- johnQdeveloper 1y ago> Does ollama have support for cpu offloading? https://www.reddit.com/r/ollama/comments/1df757o/high_cost_of_cpu_offloading/ https://www.reddit.com/r/ollama/comments/1df757o/high_cost_o... https://github.com/ollama/ollama/issues/8291 https://github.com/ollama/ollama/issues/8291 Yes.
- taneq 1y agoA perfect blend of LMGTFY and helpfulness. :)
- johnQdeveloper 1y agolol. I try not to be a total asshole, it sometime even works! :) Good luck to you mate with your life :)