3 ms·
I've completely given up on local LLMs for my use cases. The newer models available by API from larger providers are cheap enough and come with strong enough gu
by specproc 1y ago
I've completely given up on local LLMs for my use cases. The newer models available by API from larger providers are cheap enough and come with strong enough guarantees for my org for most use cases. Crucially, they are just better.
I get there are uses where local is required, and as much as the boy racer teen in me loves those specs, I just can't see myself going in on hardware like that for inference.