That's why I always download the original version and quantize myself. With enough swap, you can do it with a modest amount for ram. I never had to download a m

That's why I always download the original version and quantize myself. With enough swap, you can do it with a modest amount for ram. I never had to download a model twice. But yes, unless there is a way to patch it, bundling the model with the executable like this is going to be more wasteful.