3 ms·
Many options for running Mistral models in your terminal using LLM: https://simonwillison.net/2023/Dec/18/mistral/ https://simonwillison.net/2023/Dec/18/mistra
by Terretta 3y ago
Many options for running Mistral models in your terminal using LLM:
https://simonwillison.net/2023/Dec/18/mistral/ https://simonwillison.net/2023/Dec/18/mistral/
I liked "Using Llamafile’s OpenAI API endpoint" described there, using Justine Tunney's llamafiles for Mixtral, but the article link is out of date, as the models have been replaced with newer: https://huggingface.co/jartine https://huggingface.co/jartine