3 ms·
Use a local model. For most tasks they are good enough. Let's say Mistral 0.2 instruct is quite solid by now.
by jsemrau 3y ago
Use a local model. For most tasks they are good enough. Let's say Mistral 0.2 instruct is quite solid by now.
- gnat 3y agoDo different versions react to prompts in the same way? I imagined the prompt would be tailored to the quirks of a particular version rather than naturally being stably optimal across versions.
- jsemrau 3y agoI suppose that is one of the benefits of using a local model, that it reduces model risk. I.e., given a certain prompt, it should always reply in the same way. Using a hosted model, operationally you don't have that control over model risk.
- cpursley 3y agoWhat are the best local/open models for accurate tool-calling?