3 ms·
> The catch of course is ROCm isn't there yet (they're seeming serious now though, matter of time). Competitive AMD GPU neural compute has been any day now for
by nl 1y ago
> The catch of course is ROCm isn't there yet (they're seeming serious now though, matter of time).
Competitive AMD GPU neural compute has been any day now for at least 10 years.
- bigyabai 1y agoThe inference side is fine, nowadays. llama.cpp has had a GPU-agnostic Vulkan backend for a while, it's the training side that tends to be a sticking point for consumer GPUs.