2 ms·
There are several papers on 4/8 bit quantization, and a few implementations for Vulkan/CUDA/ROCm compilation. TBH the UIs people run for SD 1.5 are pretty unop
by brucethemoose2 3y ago
There are several papers on 4/8 bit quantization, and a few implementations for Vulkan/CUDA/ROCm compilation.
TBH the UIs people run for SD 1.5 are pretty unoptimized.