3 ms·
Probably no 4-bit quantization support? Or they are missing some ops that the tensor core cards have? My guess is AMD users will eventually get low VRAM compat
by brucethemoose2 3y ago
Probably no 4-bit quantization support? Or they are missing some ops that the tensor core cards have?
My guess is AMD users will eventually get low VRAM compatibility through Vulkan ports (like SHARK/Torch MLIR or Apache TVM).
Then again, the existing Vulkan ports were kinda obscure and unused with SD 1.5/2.1