3 ms·
> You’ve gotta deal with amd’s AI software stack though Not if you are using the CPU. I am under the impression most inference use cases are memory bandwidth l
by ac29 2y ago
> You’ve gotta deal with amd’s AI software stack though
Not if you are using the CPU. I am under the impression most inference use cases are memory bandwidth limited, not compute limited, so running on the GPU would gain you little to nothing unless the GPU has faster access to the shared memory.