4 ms·
Is this a model that can be run using Simon Wilison's LLM tool? I cannot find any mention of Mixtral in the issues nor in the discussions. Is there an easy way
by xrd 3y ago
Is this a model that can be run using Simon Wilison's LLM tool? I cannot find any mention of Mixtral in the issues nor in the discussions. Is there an easy way to play with this model from the command line other than that?
- ilaksh 3y agoollama or llama.cpp
- ignoramous 3y agoUnsure what Simon Wilson's program does, but you can pull models via many methods. For CLI, Ollama: https://ollama.ai/library/mixtral https://ollama.ai/library/mixtral With UI, GPT4All: https://gpt4all.io/index.html https://gpt4all.io/index.html (doesn't yet support Mixtral) In-app, superagent.sh: https://github.com/homanp/superagent https://github.com/homanp/superagent
- gsharma 3y agoOllama is probably the easiest way. https://ollama.ai/library/mixtral https://ollama.ai/library/mixtral LM Studio is another option.
- xrd 3y agohttps://simonwillison.net/2023/Dec/18/mistral/ https://simonwillison.net/2023/Dec/18/mistral/