> If I grab a random model from Hugging Face, will it accelerate? Probably, it depends more on how you configure the inferencing software. Most software that s

> If I grab a random model from Hugging Face, will it accelerate? Probably, it depends more on how you configure the inferencing software. Most software that supports acceleration starts with CUDA or CUBLAS, so you should be good. > If I run Blender, kdenlive, or DaVinci Resolve, will it accelerate? Yep. If you're running Linux, some distros might be a little iffy about shipping the proprietary/accelerated versions of this software, but most are fine. The Flatpak versions should all have Nvidia acceleration working out-of-box, if you do encounter any issues. > Is there a line where things break? Yes, but you can avoid it by choosing smaller quantizations and giving yourself a few gigs of VRAM headroom. In my experience, it's always better to select a model smaller than you need so you're not risking an OOM crash (I've got a 3070ti). Lotta other great advice in this thread, though! Good luck picking something out.