3 ms·
does this only work with llamaCPP ? I.e. can't use GPU models with this?
by seydor 3y ago
does this only work with llamaCPP ? I.e. can't use GPU models with this?
- joebiden2 3y agollama supports GPU by now: https://old.reddit.com/r/LocalLLaMA/comments/13gok03/llamacpp_now_officially_supports_gpu_acceleration/ https://old.reddit.com/r/LocalLLaMA/comments/13gok03/llamacp...
- seydor 3y agoHow do i enable GPU in privateGPT w llamaCpp ? It turns my CPU to a vacuum cleaner