4 ms·
The non-release of Mythos tell you the future of that, so long as they can keep the weights from being exfiltrated. Once models become true national security th
by SubiculumCode 5mo ago
The non-release of Mythos tell you the future of that, so long as they can keep the weights from being exfiltrated. Once models become true national security threats, they won't be released in their full form. The hitch-a-ride approach becomes less capable of keeping up.
- nradov 5mo agoHow would they prevent distillation? That would seem pretty tough to block for any LLM available for commercial use.
- SubiculumCode 5mo agoBy only providing degraded models to use commercially outside national defense applications would be my guess. As soon as models are a threat in terms of enabling biowarfare etc, then they just are not going to be generally released. Honestly, I think its quite possible that models will be retrained with gaps in their knowledge. e.g. a coding model for commercial use probably doesn't need to have deep knowledge of biology, and training on biological sciences probably doesn't help those evals much. Honestly, I'd welcome such an approach.
- nradov 5mo agoWhat a hilariously uninformed comment. LLMs are not the limiting factor in biowarfare.
- SubiculumCode 5mo agoLLMs absolutely have the potential to increase the risk of small nation biowarfare and bioterrorism more generally. That you don't believe so is dangerously naive.
- philipkglass 5mo agoThis post claims that Opus 4.7 has introduced some detrimental changes to stymie distillation: https://old.reddit.com/r/Anthropic/comments/1snorbg/the_biggest_nerf_in_anthropics_history_that/ https://old.reddit.com/r/Anthropic/comments/1snorbg/the_bigg... I don't know enough about distillation to understand how much this hinders/slows the process, but it sounds at least superficially plausible.
- YetAnotherNick 5mo agoWe were talking about winning commercially, not on model quality.