4 ms·
i'm honestly surprised HF doesn't have this feature yet, very useful! will you publish the code on github? any plans on adding more consumer-grade gpus?
by rokizero 1y ago
i'm honestly surprised HF doesn't have this feature yet, very useful! will you publish the code on github?
any plans on adding more consumer-grade gpus?
- PieterBecking 1y agoHey I published the code here: https://github.com/NEBUL-AI/HF-VRAM-Extension https://github.com/NEBUL-AI/HF-VRAM-Extension I've added the 4090 and 5090 as well now, make sure to get version 0.5 of the extension