3 ms·
anyone tried to quantize or use bfloat?
by mugivarra69 4y ago
anyone tried to quantize or use bfloat?
- qayxc 4y agoblfoat would indeed be nice. It's supported on a wide range of hardware (basically all mid-range to high-end Intel CPUs since 2013, AMD MI5 and up compute cards, ARM NEON and NVIDIA cards since Pascal [10-series, 2016!]). It could speed up calculations and significantly reduce memory requirements. I'd expect slightly worse results, though. edit: also https://github.com/basujindal/stable-diffusion/pull/103 https://github.com/basujindal/stable-diffusion/pull/103
- mugivarra69 4y agoneat. thanks!
- deleted 4y ago[deleted]