3 ms·

Im not sure if anyone cares about my opinion, but I think its worth mentioning that of all the models, Mixtral is IMO the best, and I do not know what Id do wit

Im not sure if anyone cares about my opinion, but I think its worth mentioning that of all the models, Mixtral is IMO the best, and I do not know what Id do without it. Fantastic news, thank you.

manishsharan 3y ago
Would you feel comfortable sharing your use case ? Also what make Mistral a better fit for your use ? Is it finetuning cost, operational cost, response times etc. ? I do not have an opportunity to explore these models in my job; hence my curiosity.
- ionwake 3y ago
  Just ask the AI where you can get laid. If you know the answer it takes less than a couple of minutes to rank all the LLMs. Sure Gemini and chatgpt may be better at counting potatoes, but why the hell would you want a better LLM which actively obscures the truth, just for a slightly more logical brain? Its the equivalent of hiring a sociopath. Sure his grades are good, but what about the important stuff like honesty? Sure it may sound a bit OTT but issues like this will only become more apparent as more alignment continues. Does alignment affect ROI? I have no idea. And if anyone cares, no Im not looking to get laid, its just the first thing that would piss off an aligned LLM.
  - lunyaskye 3y ago
    Interesting testing strategy, but you said you can't live without it. What do you actually use it for? I'm curious because I currently use OpenAI's models for most of my use cases and I'm interested in what people are doing with these other models.
    - ionwake 3y ago
      I fall back on mistral when alignment issues seem to occur. depends on the person but yeah for basically all my questions
    - wruza 3y ago
      The open secret is they are roleplaying with elf women and such. (I mean local-llm people, not gp specifically) But don't rush to dismiss it as a fringe area. Unopposed "alignment" will influence everything even slightly related to AI. It's going to be a version of modern social issues with corporate fears driving the norms (anyone who didn't live under a rock for the last ten years is aware of these), but in a subtler way. All the writings, all the articles, everything will look like max-volume DEI report. It may turn out to be a good thing in general, but also the same "good for you" as in your favorite anti-utopia.
Agentlien 3y ago
I've tried a bunch of models both online and offline and mixtral is the first one which avtively has me reaching for it instead of Google when I'm wondering about something. I also love how well it works locally with ollama. I still sometimes need to double-check its answers and be critical of its responses. But when I want to confirm the answer I suspect, or know the gist of it but want more details, I find it invaluable. It seems especially really strong in areas of science and computing. However, it consistently gives plausible but incorrect information when asked about Swedish art and culture. Though it does speak really good Swedish!
- ionwake 3y ago
  Thats awesome, thank you for sharing!
- mncharity 3y ago
  > mixtral [...] sometimes need to double-check its answers and be critical of its responses. [...] really strong in areas of science and Caveat that common science education misconceptions compromise web, wikipedia, and textbook content, and thus both llm training sets and quick double-checks. So mixtral sometimes says the Sun itself is yellow (but does usually manage white), that white light is white because it contains all colors, that individual atoms cannot be seen with a naked eye because they are too small, and so on. A lot of US science education looks like training humans on low-quality trigger-and-response pairs for llm-like "explanation". I've wondered if one could do a fine-tune, or train, on science education research's lists of common misconceptions, or on less-often-bogus sources like Science/Nature journal editorial content, and research paper introductions.

Im not sure if anyone cares about my opinion, but I think its worth mentioning that of all the models, Mixtral is IMO the best, and I do not know what Id do without it. Fantastic news, thank you.

manishsharan 3y ago

Would you feel comfortable sharing your use case ? Also what make Mistral a better fit for your use ? Is it finetuning cost, operational cost, response times etc. ? I do not have an opportunity to explore these models in my job; hence my curiosity.

ionwake 3y ago
Just ask the AI where you can get laid. If you know the answer it takes less than a couple of minutes to rank all the LLMs. Sure Gemini and chatgpt may be better at counting potatoes, but why the hell would you want a better LLM which actively obscures the truth, just for a slightly more logical brain? Its the equivalent of hiring a sociopath. Sure his grades are good, but what about the important stuff like honesty? Sure it may sound a bit OTT but issues like this will only become more apparent as more alignment continues. Does alignment affect ROI? I have no idea. And if anyone cares, no Im not looking to get laid, its just the first thing that would piss off an aligned LLM.
- lunyaskye 3y ago
  Interesting testing strategy, but you said you can't live without it. What do you actually use it for? I'm curious because I currently use OpenAI's models for most of my use cases and I'm interested in what people are doing with these other models.
  - ionwake 3y ago
    I fall back on mistral when alignment issues seem to occur. depends on the person but yeah for basically all my questions
  - wruza 3y ago
    The open secret is they are roleplaying with elf women and such. (I mean local-llm people, not gp specifically) But don't rush to dismiss it as a fringe area. Unopposed "alignment" will influence everything even slightly related to AI. It's going to be a version of modern social issues with corporate fears driving the norms (anyone who didn't live under a rock for the last ten years is aware of these), but in a subtler way. All the writings, all the articles, everything will look like max-volume DEI report. It may turn out to be a good thing in general, but also the same "good for you" as in your favorite anti-utopia.

Agentlien 3y ago

I've tried a bunch of models both online and offline and mixtral is the first one which avtively has me reaching for it instead of Google when I'm wondering about something. I also love how well it works locally with ollama. I still sometimes need to double-check its answers and be critical of its responses. But when I want to confirm the answer I suspect, or know the gist of it but want more details, I find it invaluable. It seems especially really strong in areas of science and computing. However, it consistently gives plausible but incorrect information when asked about Swedish art and culture. Though it does speak really good Swedish!

ionwake 3y ago
Thats awesome, thank you for sharing!
mncharity 3y ago
> mixtral [...] sometimes need to double-check its answers and be critical of its responses. [...] really strong in areas of science and Caveat that common science education misconceptions compromise web, wikipedia, and textbook content, and thus both llm training sets and quick double-checks. So mixtral sometimes says the Sun itself is yellow (but does usually manage white), that white light is white because it contains all colors, that individual atoms cannot be seen with a naked eye because they are too small, and so on. A lot of US science education looks like training humans on low-quality trigger-and-response pairs for llm-like "explanation". I've wondered if one could do a fine-tune, or train, on science education research's lists of common misconceptions, or on less-often-bogus sources like Science/Nature journal editorial content, and research paper introductions.