4 ms·

My experience, and also what I’ve seen from a few YT videos as well, is that the local LLMs just aren’t as good as Claude and chatGPT. They don’t seem to unders

• fallinditch 2y ago
  Yes, good point. The latest LLMs from Anthropic, Open AI etc will always be more powerful than your local LLM. I reckon that the cutting edge cloud-based models will (continue to) provide enormous value for a range of complex actions, but that we will also derive great value from our own personal and organizational local models running on our devices and LANs. I'm assuming that small specialized LLMs for coding will become 'good enough' for a significant proportion of tasks. For example, when Codestral came out earlier this year it supposedly beat Meta’s CodeLlama 70B model in all of the top coding evaluation benchmarks, even though it's 3 x smaller.