3 ms·
Why bother with the safety checker if the model is running locally? I wonder how much faster it would be if the safety checks were skipped.
by ForkMeOnTinder 3y ago
Why bother with the safety checker if the model is running locally? I wonder how much faster it would be if the safety checks were skipped.
- ozr 3y agoNot much faster tbh, but it's a bit of virtue signaling you're often required to do with generative AI.
- whatsthenews 3y agoSeems like a waste of time, more of a nice to have/tip of the cap to yud
- deleted 3y ago[deleted]
- radicality 3y agoWas gonna comment the same thing, feels ridiculous to include it here for local use. I believe you should be able to remove it if you edit the python inference code from huggingface. edit: I tried it out by copying this pipeline file locally and then disabling the safety checker. https://raw.githubusercontent.com/huggingface/diffusers/main/examples/community/latent_consistency_txt2img.py https://raw.githubusercontent.com/huggingface/diffusers/main... On my M1 macbook, did a test of 10 images, including the one-off loading time. With checker: 10.51s, without safety checker: 9.48s. So not that big of a hit.
- deleted 3y ago[deleted]
- Turing_Machine 3y agoI agree. It's pretty easy to bypass if you know a bit of Python, though. Doing a search for "nsfw" in all subdirectories seems to turn up all the files you need to edit.
- 00deadbeef 3y agoYou only need to add two lines to the example main.py file to disable it, no need to go editing anything else