7 ms·

This has dampened my opinion on Anthropic quite a bit. It's difficult to take their marketing for AI as an empowering technology seriously when they are quite c

• thewebguyd 4mo ago
  Don't forget their push for full regulatory capture in the name of "safety" as well so they can pull the ladder up behind them before anyone else has an equally capable model and releases it without the anti-competitive safeguards, while also pushing to completely ban open weight models, or any model trained on a certain level of compute without "rigorous" government testing and validation (which I'm sure, they'll conveniently provide the framework for). Dampened opinion on Anthropic is an understatement.
  • xvector 4mo ago
    [flagged]
    • Cpoll 4mo ago
      How does US regulatory capture do anything to impede PRC's advance?
      • shimman 4mo ago
        Nothing, they are just trying to scare monger the public and prime the pump for a massive bailout when it crashes out because apparently China are the big bad meanies.
        • solenoid0937 4mo ago
          You'd be fine if the PRC gets to ASI first? That's an interesting opinion.
          • thewebguyd 4mo ago
            It has nothing to do with being "fine" if the PRC or anyone else for that matter get to some speculative and hypothetical ASI first. There are zero US regulations that would be effective to prevent that. US regulations apply to US companies and citizens, exclusively. Anthropic crowding out all future potential competitors in the US via regulatory capture has no weight on what the rest of the world does. Unless you are proposing military action over a speculative sci-fi future
          • zozbot234 4mo ago
            PRC labs reportedly aren't even thinking about getting to ASI, much less trying. They think of AI as a technology that can provide utility across the board even without anything like superhuman smarts.
            • ff3 4mo ago
              A lot of this lust for ASI is driven by America attempting to cling onto the power it has wielded over the world over the past 50 odd yrs. It smells of paranoia.
            • solenoid0937 4mo ago
              Nope, they're accelerating towards superhuman smarts as fast as they can too.
          • shimman 4mo ago
            No, because there is zero reason to think LLMs will lead to it but we do know that the massive LLM investment has a huge financial risk for the US. Not too mention it's exacerbating the climate crisis (you know the actual thing that might end civilization, not a fantasy delusion of AGI), giving citizens cancer that live next to data centers, the extreme decrease in quality of life, and the misallocation of capital while Americans lack healthcare, childcare, housing, and education. Also don't believe China is actually a threat to the world. That's some cold war delusional think you got there. All the companies seem to believe is that it's okay to immiserate a large percentage for the pursuit of money, you seem to believe the lies they're feeding you.
    • deleted 4mo ago
      [deleted]
    • deleted 4mo ago
      [deleted]
    • thewebguyd 4mo ago
      And why would any regulations put in place in the USA affect the PRC in anyway whatsoever? They wouldn't. China will continue to push forward and govern things in their own way, we have zero jurisdiction over China. So yes, it is regulatory capture.
    • iAMkenough 4mo ago
      I don’t think they’re mutually exclusive. It’s a business selling a product that isn’t yet profitable, not a public advocacy organization.
    • raincole 4mo ago
      What backward logic is this? PRC doesn't give a fuck about how US regulates AI companies. Pushing more regulation would ensure that Chinese companies catch up sooner. If you think otherwise you need to think harder.
      • oncensher 4mo ago
        The original topic was Anthropic's guardrails, which were meant in part to stop China from using Anthropic's models to bootstrap their own. I take it the logic of the comment was that pulling attention to Anthropic's stance on regulation is switching to the topic. But for what it's worth, I also think that people are way to quick to assume that strong regulations would only help China and thereby hurt safety. There are many reasons why the opposite may be true: - reducing demand for Chinese models reduces the incentive for Chinese companies to make them - if US companies can't use Chinese models, they won't have an incentive to help their development - China may enact similar regulations if the US leads, either out of concern for US safety or for commercial reasons Also, I think some similar things can be said about AI safety measures in China aside from regulation. Currently, the US leads in model safeguards, but it isn't like China has zero interest in AI safety. Even if the US and China are rivals, there are many points of common interest (biorisk and "sci-fi" scenarios like an AI takeover, to name just two).
        • thewebguyd 4mo ago
          I don't subscribe to the belief that regulations in the US will lead to China advancing further. But I also don't buy into the "China bad" narrative that gets frequently spread in online circles and in political circles. Its the cold war all over again, but this time its China instead of the Soviet Union. Regardless of that, the regulations being proposed by Anthropic recently are not focused on the current issues which is my problem with all the hype marketing around hypothetical AGI/ASI. What is being proposed to be put in place will further cement the current frontier labs in their marketing leading position, and work to block new entrants, and open source competitors. That is the problem. The other problem is none of them are talking about the real, difficult issues we are experiencing right now in the present. We don't need to talk about a sci-fi future scenario to recognize that LLMs have already caused and are causing harm in the real world. "We should probably regulate future frontier models" does nothing to help the current issues. Wake me up when Anthropic says "The government should immediately stop us from hoovering up data and selling it back to the public. They should immediately stop us and others from enabling misinformation at scale that is already negatively effecting our democratic process. They should immediately stop us from building out new data centers until we have a large scale switch to renewables in the country, shore up the grids, or force us to generate our own power only with renewables" so on and so forth. Notice how any time the labs propose regulations, its only for a future hypothetical super intelligent model. Its never about their current operational liabilities.
    • theLiminator 4mo ago
      This take is ridiculous, the PRC is not going to care at all about US regulations.
    • thewebguyd 4mo ago
      > asking for domestic safety testing of frontier models only is not regulatory capture It very much is regulatory capture. The goal is to make it so only the handful of heavily capitalized tech giants and frontier labs can afford the legal and compliance rigamarole to meet the new standards. It's an effort to crowd out open source development and smaller competitors (and foreign competitors which threaten whatever moat they may have). They define safety through some speculative catastrophic threat to prevent new upstarts instead of focusing on the very real, localized harm they are causing right now. Its also shifting the definition of safety away from their current operations and toward purely speculative future scenarios.
    • notahacker 4mo ago
      I didn't downvote, but HN probably remembers when Anthropic's competitor was a "charity" that cared deeply about AI safety whose marketing gimmick was GPT-2 being too dangerous to release. Anthropic's founder wants you to buy into his vision for safety, but he also wants you to buy into his vision that in two years AI will be a "country of geniuses" that will update itself, and the IPO that will fund it...
    • antonvs 4mo ago
      > "Why does a company that cares about the dangers of AI/ASI and x-risk, not want the PRC to catch up to the frontier?" Because it’s a threat to ultracapitalist dystopia that they’re tripling down on. The dangers and risk are coming from inside the house. The danger they care about is the danger to their monopoly, control, and wealth.
    • gmerc 4mo ago
      Ohh, the red scare, never gets out of fashion. Meta's David Marcus in the Senate: If you don't let use launch crypto, the chinese will win. The Chinese banned crypto instead
      • inigyou 4mo ago
        They're not even red any more. They're fully capitalist with dictatorship characteristics.
    • CuriouslyC 4mo ago
      Right now the PRC is looking like the adult in the room. They also have a view of how AI should work that's smaller and more worker centric rather than trying to create superintelligent worker replacements. The PRC (like any superpower) has done some bad shit, but if you're going to paint them as the bad guy keep in mind the USA has a long, long history of genocide, slavery, overthrowing foreign governments for corporate interests, unjust wars, political meddling, etc. The scales of righteousness don't tip in our favor TBH, we just have better PR and a nicer veneer over our brutality.
      • thesmtsolver2 4mo ago
        > Right now the PRC is looking like the adult in the room Only if you ignore history. Didn't the PRC violate every known labor/enviromnetal/human-rights standard to become the top in manufacturing? https://matthewekahn.substack.com/p/what-role-did-regulations-play-in https://matthewekahn.substack.com/p/what-role-did-regulation...
        • CuriouslyC 4mo ago
          The US did the same thing. Environmentalist and workers rights movements date back to the 19th century. China's position on this is that the western nations that already developed are trying to pull the ladder they used up and wag a finger with false morality with the intent of maintaining global hegemony.
          • thesmtsolver2 4mo ago
            > The US did the same thing. Except that there were no global standards at the time. You can't point to any single country and say they were doing worse. They all were bad. But China actively flouted established international norms. Now that is behind in AI it is clamoring for controls for others. https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3692695 https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3692695 > are trying to pull the ladder they used up Every country spies and steals but it is the scale we are talking about. China does it at a scale that dwarfs any historical or current comparisons. China doesn't have any grounds here when they turn around and complain about India copying its playbook: https://economictimes.indiatimes.com/industry/renewables/china-wto-complain-against-india-ev-manufacturing-scheme-china-wants-india-to-stop-copying-its-playbook/articleshow/124598355.cms?from=mdr https://economictimes.indiatimes.com/industry/renewables/chi...
    • dragonwriter 4mo ago
      > asking for domestic safety testing of frontier models only is not regulatory capture. Yeah, asking for additional state-provided barriers to a market entry to a valuable market a provider already is one of a narrow few dominating only for firms that are a competitive threat is exactly regulatory capture.
    • satvikpendem 4mo ago
      The flawed premise is thinking that AGI is a real risk, and that they care about it more than making money, that is why HN does think it's simply regulatory capture.
  • reactordev 4mo ago
    They are the only ones I’ve contacted my bank to get a charge back on…
    • trhway 4mo ago
      i wonder if some lawyer may see a consumer protection class action here. In my view the Stuxnet that Anthropic pulled over its customers isn't much different from say those unauthorized extra accounts by Wells Fargo.
      • reactordev 4mo ago
        exactly my thoughts as well when I got my money back.
• inferniac 4mo ago
  Wouldnt call their goverment disagreements performative, they genuinely believe they should be the only ones deciding what AI can and cannot do
  • deleted 4mo ago
    [deleted]
• Rapzid 4mo ago
  "Only I can save us". It's a classic tragedy and cautionary tale. The idea Anthropic was going to speed run AI so they could control the usage and make it "safe" for humanity was never altruistic; it was a HUGE FUCKING RED FLAG.
  • xvector 4mo ago
    [flagged]
    • olbeardGear 4mo ago
      [dead]
    • gmanley 4mo ago
      Correct, they should. If there are zero days out there, then they should be able to be found by everybody, instead of only being found by the select elite that this model is available to. Though, I very much question the truth of said ability.
    • thewebguyd 4mo ago
      And? Now all the zero days, if thats true, get discovered and patched instead of being exclusively hoarded by the select few governments and Israeli spyware companies. Sounds like a great thing to me.
    • deleted 4mo ago
      [deleted]
  • DANmode 4mo ago
    Benevolent dictators work. But, looking to a US corp to be one? That’s daft.
    • hungryhobbit 4mo ago
      They do, but only for specific definitions of "work". Like, benevolent dictators in Cuba 100% raised the literacy rate by an insane amount in just a few years (something like 20% => 80%"). If you define work as "literacy", they no doubt succeeded. But if you consider the people (and children) they tortured, raped, and murdered, suddenly literacy doesn't seem so important.
• californical 4mo ago
  Yeah, I cancelled my Claude subscription yesterday after learning about their attitude of intentionally sabotaging their paying customers. Especially after trying Fable yesterday for some benign projects and being unimpressive relative to opus. Rolling it back is the right move, but I’m still not convinced that using them is in my best interest anymore, I’m investigating open source cloud providers now.
  • solenoid0937 4mo ago
    Opus is nowhere close to Fable. Fable feels at least one generation ahead to me. https://x.com/hyperagentapp/status/2064396004032463157 https://x.com/hyperagentapp/status/2064396004032463157 Edit: OpenAI will launch a similar model soon and I can't wait. We are entering a new era of agents.
    • deleted 4mo ago
      [deleted]
    • itintheory 4mo ago
      Care to share any specifics?
      • noworriesnate 4mo ago
        I have a design for a really complex software I want to build and there were gaps I knew of in the design. Opus couldn’t identify them but Fable did. I’m just talking about it reviewing the design, not coding. But yeah, it’s insanely expensive. It does spin off sub agents so I suspect it might be cheaper if you had it create a bunch of plan files and then pointed deepseek at this plan files or something like that
    • conjectures 4mo ago
      What does this even mean?
      • beng-nl 4mo ago
• varenc 4mo ago
  Google has been doing the same thing for longer than Anthropic[0]. To protect their models from distillation attacks, they silently will downgrade the model's performance to essentially poison your training data without your knowledge. A bit different than Anthropic refusing to assist with any AI development at all, but it's in the same vein and seems not widely known. edit: reading the whole series of Google's AI Threat Tracker articles also provides some insight into threats Anthropic and others are dealing with [0] https://cloud.google.com/blog/topics/threat-intelligence/distillation-experimentation-integration-ai-adversarial-use#:~:text=Google%20continuously%20detects%2C%20disrupts%2C%20and%20mitigates%20model%20extraction%20activity%20to%20protect%20proprietary%20logic%20and%20specialized%20training%20data%2C%20including%20with%20real%2Dtime%20proactive%20defenses%20that%20can%20degrade%20student%20model%20performance. https://cloud.google.com/blog/topics/threat-intelligence/dis...
  • chiwilliams 4mo ago
    Thanks for flagging this. This is interesting
  • m3kw9 4mo ago
    It's a 2 horse race, and google is not one of them right now.
• vlan0 4mo ago
  Corporation cannot help but act this way. They are too big. The pressures for profit are all that matters. That is the priority. It doesn't matter what colorful words they put on the paper to make you feel better. Look at the "green" movement 20 years ago. All talk and no action. Stop supporting organizations that don't put humans first. Don't believe a word that anyone says. Lip service is free
• olbeardGear 4mo ago
  [dead]
• dominotw 4mo ago
  Dario's life story arc in his head when he realized what ai can do. Capture this thing and become the king of the world.
• giancarlostoro 4mo ago
  Even with them making those guardrails visible, it's a bit ridiculous in my eyes. I have been experimenting with smaller models, will Claude assume I'm some Chinese or Russian agent trying to distill their secrets and bar me from learning? Because that's insane. What if I discover a more efficient way to build models with Claude? Well, we'll never know now. What if someone else entirely could discover a breakthrough in how we design and build LLMs.
  • ff3 4mo ago
    The whole shtick is to get you addicted whilst reducing your ability to go without, acquire power over you, jack up the prices whilst manipulating the quality of the tokens/output available to you. Cant believe how stupid people are. You couldnt see this coming? Shame on you.
    • giancarlostoro 4mo ago
      I already made up my mind, I'm not using that model if its sending proprietary code over to Anthropic, they can kiss my rear. If every frontier model winds up doing this, I will stop using them. There's plenty of employers / jobs where this is not okay behavior from an LLM.
• tlb 4mo ago
  Yes, that is basically the plan. It's based on the belief that unfettered AI would let anyone be a supervillain and destroy the world. There are enough would-be supervillains out there, but they rarely get far because they can't get teams of smart people to build doomsday machines for them. So the AI has to not let anyone do evil with it. Unfortunately, that won't feel very much like freedom.
  • lebovic 4mo ago
    It sounds like you might not agree with that belief. While I don't agree with their actions here, I do think there's sufficient reason to hold that belief. On some fronts (e.g. security, on which you've experienced more than me), I think there are surmountable challenges. But on other fronts (e.g. bio), a single errant actor could reasonably kill millions or billions of people with sufficiently powerful AI. We don't have good defenses here, and those actors do exist. I still don't agree with these actions, but I do think I agree with their assumptions.
    • zozbot234 4mo ago
      The model release cards for Opus have repeatedly and consistently stressed that the model doesn't have the fiddly know-how that's required to provide meaningful assistance in possibly dangerous subfields of biology. Mythos (Fable without the overly strict guardrails) has shown improvements in things like drug design, but even then the situation isn't really that different. This risk is ridiculously overblown, and the way to manage it sensibly is to introduce meaningful oversight for actors that seek to order the actual specialized materials involved (especially any synthetically generated genes/proteins/whatever).
      • lebovic 4mo ago
        No, Anthropic's model cards have claimed that the models don't show considerably more uplift than previous ASL-3 models, which already showed material uplift. I participated in the internal bioweapons uplift test for Sonnet 3.7, and even then, one non-expert got huge uplift from the model [1]. I'd consider evals a lower bound of capabilities that can be elicited from a model. The team behind Biomni, a biomedical agent that's widely used by researchers, has continued to find consistent gains between models [2]. I trust them, because I visited them to build their HPC tool [3], which the model is quite capable of using – moreso than most grad students. The Biomni team cares a lot about about real usability for real researchers, so they have a great pulse on capabilties. SecureBio also has some public evals [4], which have continued to show increasing uplift. And while synthesis monitoring is a part of the solution, I think you might underestimate how much goes under the radar. See the Reedley lab incident for an example [5]. Is Anthropic still effectively throttling beneficial biomedical research? Yes! And so is OpenAI. But the underlying capability is still actually dual use. [1]: See page 25 in https://www-cdn.anthropic.com/9ff93dfa8f445c932415d335c88852ef47f1201e.pdf https://www-cdn.anthropic.com/9ff93dfa8f445c932415d335c88852... [2]: Their benchmark has a preprint at https://www.biorxiv.org/content/10.64898/2026.05.12.724604v1.full.pdf https://www.biorxiv.org/content/10.64898/2026.05.12.724604v1... [3]: https://x.com/phylo_bio/article/2029233694775624096 https://x.com/phylo_bio/article/2029233694775624096 [4]: https://securebio.org/ https://securebio.org/ [5]: Search for "ebola" in the public report for the Reedley lab incident at https://chinaselectcommittee.house.gov/sites/evo-subsites/selectcommitteeontheccp.house.gov/files/evo-media-document/scc-reedley-report-11.15.pdf https://chinaselectcommittee.house.gov/sites/evo-subsites/se...
• pdntspa 4mo ago
  That level of control will be fleeting at best; as soon as the open models and competitors catch up they lose that influence
  • simplyluke 4mo ago
    That's why Dario's advocating for making open weight models illegal and also saying we should stop the clock on model development amongst the large labs.
• dragonwriter 4mo ago
  > If it was just plain monetary concerns and sabotage of competitors I'd almost be fine with it, but it seems they actively want to monopolize most of human progress in their enlightened hands But that is “plain monetary concerns and sabotage of competitors”, they are just more ambitious than most people doing sabotage of competitors in the fields they hope to dominate by that tactic.
• satvikpendem 4mo ago
  First time? They've always been misanthropic, ironically. They seem to hate their users and think that their AI is so dangerous it'll destroy the world and not to be trusted, I mean Anthropic was literally started because people at OpenAI thought the latter was too forgiving on "safety."
• rurp 4mo ago
  Yeah I'd say this has been a big concern ever since it turned out immensely expensive training methods could create effective frontier models. So far at least, open source models have kept up better than I expected, but they definitely lag the top ones and there's no guarantee the gap doesn't widen further. Imagine the software world if Linux never existed as an effective OS and Microsoft + Apple had completely controlled computer platforms for the past decades. I think it's almost certain that both companies would be even more profitable, and the tech industry would be vastly less free and more dysfunctional .
• FpUser 4mo ago
  >"but it seems they actively want to monopolize most of human progress in their enlightened hands, lest the mob does something undesirable with these powers" I think this is exactly what they want.
• BenRather 4mo ago
  Americans continuing to act shocked they're being cucked by corporations dampens trust and makes it difficult to buy into memes Americans are "exceptional" and "gritty", "educated", "world leaders". Seriously the world is watching the American public get porked by grandpa and reconsidering putting their trust in not just US government as that's clearly failed, but the people themselves. Occasional weekend warrior protest while our government destabilizes their lives? That's all the effort ya got for global allies and partners, eh?
• squigglingAvia 4mo ago
  And we subsidize them (AI companies in general) with our tax dollars.
  • hungryhobbit 4mo ago
    But, to be fair, we subsidize all of corporate America, not just AI companies.
• oh_my_goodness 4mo ago
  Wait until you see the enshittification phase.
• maxdo 4mo ago
  how did you read it this way? Distill is such a big problem that distill attempts consist a significant share of their revenue(!). A distill model with easy jailbreak can easily be used to coordinate terrorist attacks, or hostile government attacks. Read russia, north korea etc. A distilled model can be used to rob your grandma in a very effective way. It's no longer about placing a few business logic requirements in js + css on your website. wake up .
• matheusmoreira 4mo ago
  Same. I'm not sure I can trust them again. I'm investigating open weight models.
• tietjens 4mo ago
  Someone on here once point out that their CTO worked at Oracle and I haven't been able to forget that since.