3 ms·

Any speculation why the AMD cards require twice the VRAM that Nvidia cards do? I have an RX 6700 XT and I'm disappointed that my 12 GB won't be enough.

• brucethemoose2 3y ago
  You will want an optimized implementation from torch-mlir or apache tvm anyway. We had this for SD 1.5, but it always stayed obscure and unpopular for some reason... I hope its different this time around.
• jacooper 3y ago
  Your 6700XT won't work anyway, since its not supported by ROCm
  • brucethemoose2 3y ago
    The 6000 series "unofficially" works with rocm, and that is hopefully getting more official.
  • dharmab 3y ago
    It works on my 6900XT with ROCm
    • jacooper 3y ago
      Because anything higher the 6800 is unofficially supported
  • kreig 3y ago
    That's not accurate, I was able to make my old RX 5500XT work with ROCm some months ago, only after 6 hours of compilation process though...
    • jacooper 3y ago
      Its not supported, only navi 21 is supported, which is RX 6800+ https://github.com/RadeonOpenCompute/ROCm/issues/1668 https://github.com/RadeonOpenCompute/ROCm/issues/1668
• brucethemoose2 3y ago
  Probably no 4-bit quantization support? Or they are missing some ops that the tensor core cards have? My guess is AMD users will eventually get low VRAM compatibility through Vulkan ports (like SHARK/Torch MLIR or Apache TVM). Then again, the existing Vulkan ports were kinda obscure and unused with SD 1.5/2.1