3 ms·
Meta plans to not open the weights for its 400B model
- jmpman 2y agoDisappointed. I’d planned to download the model, and build a system powerful enough to run it locally.
- asne11 2y agoI thought their whole point of opening the models in the first place was to undermine OpenAI, but this seems to invalidate that. Maybe their hand was forced?
- blackeyeblitzar 2y agoI wonder if it has to do with Meta recently joining the “Frontier Model Forum” industry group alongside Microsoft and Google and OpenAI and Anthropic. AKA the group for regulatory capture by playing up “trust and safety”. They are the ones pushing for regulations which will potentially make it illegal to build models that are open or uncensored. https://www.theguardian.com/technology/2023/jul/26/google-microsoft-openai-anthropic-ai-frontier-model-forum https://www.theguardian.com/technology/2023/jul/26/google-mi... https://www.frontiermodelforum.org/updates/amazon-and-meta-join-the-frontier-model-forum-to-promote-ai-safety/ https://www.frontiermodelforum.org/updates/amazon-and-meta-j... This whole group has a dystopian vibe to it, with forced assumptions for its members: “Member firms must publicly acknowledge that frontier AI models pose both public safety and societal risks, and publicly disclose guidelines for evaluating and mitigating those risks.” In other words, all the members must amplify the same safety tropes to force regulation on the rest of us.
- wruza 2y agoHow cleverly they sold the idea of LLM safety to everyone, as if it was an actually dangerous thing.
- jazzyjackson 2y agothey never promised they would
- ErikBjare 2y agoI don't think this tweet is an authoritative source
- ad8e 2y agoAgree, but I've seen other open-source ML people confirm it. For example: Teknium: Okay and Ive had 4 high-ish level sources tell me they dont plan to release it ever though