2 ms·
Definitely! ROCm is getting really solid for inference. LM Studio (and therefore the underlying llama.cpp) work out of the box already, and we see AMD pushing
by nrp 2y ago
Definitely! ROCm is getting really solid for inference. LM Studio (and therefore the underlying llama.cpp) work out of the box already, and we see AMD pushing forward on PyTorch and other areas rapidly.