2 ms·
Eh. Trading CUDA for 8 more gigs seems like bad deal, unless you know absolutely for certain what you want to run will run on it.
by fluoridation 6mo ago
Eh. Trading CUDA for 8 more gigs seems like bad deal, unless you know absolutely for certain what you want to run will run on it.
- cmxch 6mo agoUntil NVidia prices get better, I’ll build out with the Intel stack and keep the cache (and prompt processing speeds) happy. As for software, anything that has a SYCL or Vulkan backend, and/or can be Intel optimized (especially to the same degree as llama.cpp) can run well.