3 ms·
I haven't tested programming tasks with a local LLM vs. say, Claude 3.5. But it is nice to be able to run 14-32B LLMs locally and get an instant response. I hav
by unethical_ban 2y ago
I haven't tested programming tasks with a local LLM vs. say, Claude 3.5. But it is nice to be able to run 14-32B LLMs locally and get an instant response. I have a single 3090.
- prettyblocks 2y agoSame here. I just built a pc with a 3090 for local llm and stable diffusion and have zero regrets.