4 ms·
Anthropic has released open weight models for translating the activations of existing models, viz. Qwen 2.5 (7B), Gemma 3 (12B, 27B) and Llama 3.3 (70B) into na
by zozbot234 6mo ago
Anthropic has released open weight models for translating the activations of existing models, viz. Qwen 2.5 (7B), Gemma 3 (12B, 27B) and Llama 3.3 (70B) into natural language text. https://github.com/kitft/natural_language_autoencoders https://github.com/kitft/natural_language_autoencoders https://huggingface.co/collections/kitft/nla-models https://huggingface.co/collections/kitft/nla-models This is huge news and it's great to see Anthropic finally engage with the Hugging Face and open weights community!
- rvz 6mo agoWe already know Anthropic does open source for a while such as the "flawed" MCP spec and "skills" spec. This release is only done on other open-weight LLMs which have been released and even though they will use this research on their own closed Claude models, they will never release an open-weight Claude model even if it is for research purposes. So this does not count, and it is specifically for the sake of this research only.
- zozbot234 6mo agoIt's literally an open model that generates natural language text (or one that takes in text and turns it into activations). Why does engagement with the local models community "not count" if it isn't Claude? That makes very little sense to me.
- mnkyokyfrnd 6mo agoBecause we know what Embrace, Extend, and Extinguish means for example.They're leeching off opensource, not contributing in any meaningful way.
- bastawhiz 6mo agoSorry, what are they embracing and extending?
- stingraycharles 6mo agoChinese open models? /s To counter the grandparent you’re replying to: Embrace, Extend & Extinguish is a Microsoft strategy. So is FUD, and that’s all this is.
- NiloCK 6mo agoHumanity!
- sanex 6mo agoThose are generally used by someone who is behind. See: everything meta does.
- stingraycharles 6mo agohttps://github.com/kitft/natural_language_autoencoders https://github.com/kitft/natural_language_autoencoders Here’s the full source code for training your own NLA, provided by Anthropic.
- razodactyl 6mo agoI appreciate a critical eye so I upvoted but consider how your message is received / worded for more impact in future.
- jimmySixDOF 6mo agoExcept Qwen already release their own fully baked interpretability SAE toolkit tuned on their models so deserve credit here and activation telescopes should be a standard part of every major release [1] https://qwen.ai/blog?id=qwen-scope https://qwen.ai/blog?id=qwen-scope
- aesthesia 6mo agoSAEs are useful, and the Qwen release is great, but this is a different thing entirely.