3 ms·
Do you have any recommendations on models to try?
by logankeenan 2y ago
Do you have any recommendations on models to try?
- stkdump 2y agoMixtral and Deepseek use MOE. Most others don't.
- Terretta 2y agoMixtral 8x22b https://mistral.ai/news/mixtral-8x22b/ https://mistral.ai/news/mixtral-8x22b/
- terhechte 2y agoIn addition to the ones listed by others, WizardLM2 8x22b (was never officially released by Microsoft but is available).
- memhole 2y agoI planted garlic this year. Thanks for documenting! I can’t wait to see what I get harvest time. I like the Llama models personally. Meta aside. Qwen is fairly popular too. There’s a number of flavors you can try out. Ollama is a good starting point to try things quickly. You’re def going to have to tolerate things crashing or not working imo before you understand what your hardware can handle.