3 ms·
Running local models isn't about the cost, its about owning your own data and being able to run uncensored models. If you just want to code with an assistant, l
by ActorNightly 1mo ago
Running local models isn't about the cost, its about owning your own data and being able to run uncensored models. If you just want to code with an assistant, local inference is by far not worth it.
You also don't need to run the models 24/7, nor is your computer gonna be doing inference all the time when you are coding.
- nomel 1mo agoNo, you're mixing unrelated concepts here. Cloud does not mean you don't own the data, and can't do what you want. It means it's running on commoditized server hardware, powered with cheap commercial energy costs, oversubscribed so nothing sits idle.