4 ms·

From the article: > For the same reason that Microsoft probably continued to train Phi-style models: safety. Releasing an open-source model is terrifying for a

From the article: > For the same reason that Microsoft probably continued to train Phi-style models: safety. Releasing an open-source model is terrifying for a large organization. Once it’s out there, your name is associated with it forever, and thousands of researchers will be frantically trying to fine-tune it to remove the safety guardrails. I don't think this is really an issue in practice. Llama 2 and 3 were uncensored within a week. There's no bad press about this. What does give a company a bad reputation is crap models. The llama 4 disappointment hurt meta's AI reputation a lot more than some community uncensoring.

teruakohatu 1y ago
> researchers will be frantically trying to fine-tune it to remove the safety guardrails. It is a really weak excuse. They are more likely to take a reputation hit for having silly guardrails than for having someone to remove them. Imagine if Bill Gates decided not to release MS Paint in 1985 because someone could have drawn something offensive with it.
- anshumankmr 1y ago
  Or imagine if Bill Gates decided to not release Comic Sans in the 90s cause someone could have written something offensive with it.... oh wait that wouldn't have been too bad (/S)
  - wkat4242 1y ago
    I like it. Just block anything that uses it, and you have cleaned up a big part of your internet and lost nothing of value.
- umeshunni 1y ago
  > Imagine if Bill Gates decided not to release MS Paint in 1985 because someone could have drawn something offensive with it. Quite believable that this could have been the case in 2021.
CjHuber 1y ago
If I think about Llma, I think about uncensored. not that I ever used one, but there were not many use cases for censored llama when others were so much better at other things
- wkat4242 1y ago
  Hmm? For me it's still the best model for general use. That I've tried at least. Gemma and phi I didn't like so much. Qwen is chinese and I've had bad experiences with those (reverting to Chinese when they get confused). Not for knowledge, but I combine it with searches of course. None of the small models are good at knowledge.
  - CjHuber 1y ago
    So you are using local models for general use? For me when it’s not ultra sensitive information, I don‘t want a just good enough LLM so I use the API of a proper large one.
    - wkat4242 1y ago
      For me good enough is usually good enough (and pretty excellent). Unless I ask for something really complex, then I use perplexity in research mode. But I have everything in OpenWebUI so I can choose with a touch of a button. Sometimes I wonder whether GPT could have done better and I try it and it's usually not significantly better than llama 3.1 8b
    - wkat4242 1y ago
      By the way, I usually use the AI for filtering, summarisation etc. Not for facts (like "what would be the best model of CPU I could buy" or "what is the capital of Estonia". When I do that I will link it to web searches anyway. Small models are indeed pretty useless for asking facts from. But big models can't be relied on either. They still hallucinate a lot. So I tend to combine it with web searches so I also have the references. But in general the whole fact thing for me is not a big usecase for AI.

teruakohatu 1y ago

> researchers will be frantically trying to fine-tune it to remove the safety guardrails. It is a really weak excuse. They are more likely to take a reputation hit for having silly guardrails than for having someone to remove them. Imagine if Bill Gates decided not to release MS Paint in 1985 because someone could have drawn something offensive with it.

anshumankmr 1y ago
Or imagine if Bill Gates decided to not release Comic Sans in the 90s cause someone could have written something offensive with it.... oh wait that wouldn't have been too bad (/S)
- wkat4242 1y ago
  I like it. Just block anything that uses it, and you have cleaned up a big part of your internet and lost nothing of value.
umeshunni 1y ago
> Imagine if Bill Gates decided not to release MS Paint in 1985 because someone could have drawn something offensive with it. Quite believable that this could have been the case in 2021.

CjHuber 1y ago

If I think about Llma, I think about uncensored. not that I ever used one, but there were not many use cases for censored llama when others were so much better at other things

wkat4242 1y ago
Hmm? For me it's still the best model for general use. That I've tried at least. Gemma and phi I didn't like so much. Qwen is chinese and I've had bad experiences with those (reverting to Chinese when they get confused). Not for knowledge, but I combine it with searches of course. None of the small models are good at knowledge.
- CjHuber 1y ago
  So you are using local models for general use? For me when it’s not ultra sensitive information, I don‘t want a just good enough LLM so I use the API of a proper large one.
  - wkat4242 1y ago
    For me good enough is usually good enough (and pretty excellent). Unless I ask for something really complex, then I use perplexity in research mode. But I have everything in OpenWebUI so I can choose with a touch of a button. Sometimes I wonder whether GPT could have done better and I try it and it's usually not significantly better than llama 3.1 8b
  - wkat4242 1y ago
    By the way, I usually use the AI for filtering, summarisation etc. Not for facts (like "what would be the best model of CPU I could buy" or "what is the capital of Estonia". When I do that I will link it to web searches anyway. Small models are indeed pretty useless for asking facts from. But big models can't be relied on either. They still hallucinate a lot. So I tend to combine it with web searches so I also have the references. But in general the whole fact thing for me is not a big usecase for AI.