3 ms·
I tried using schnell, it won't fit in a 16gb GPU, and I couldn't get it to run on CPU.
by nubinetwork 2y ago
I tried using schnell, it won't fit in a 16gb GPU, and I couldn't get it to run on CPU.
- TobTobXX 2y agoI've sucessfully run schnell and dev on a 12G GPU. They do take 40s/60s repectively, but it works. I used ComfyUI and didn't have to tweak anything.
- washadjeffmad 2y agoTry an fp8: https://huggingface.co/Kijai/flux-fp8/ https://huggingface.co/Kijai/flux-fp8/