10 ms·
The hacker sent by Anthropic to calm the government's nerves about AI safety
Readable: https://www.wsj.com/tech/ai/anthropic-mythos-safety-nicholas-carlini-20bceaa3?st=gj26io&reflink=desktopwebshare_permalink https://www.wsj.com/tech/ai/anthropic-mythos-safety-nicholas...
- boramdd 4mo agoBeing on the other side of the AI machine changes the perspective of whether it is dangerous or not, I guess.
- deleted 4mo ago[deleted]
- speedgoose 4mo agoEveryone has a price.
- trhway 4mo agothe coming IPOs will possibly create several billionaires. Standing on the top of a billion dollar pile would definitely change your perspective.
- parl_match 4mo agoI have good friends in the AI industry who are the living embodiment of that Upton Sinclair quote. "It is difficult to get a man to understand something, when his salary depends on his not understanding it." You've never heard such strong one-sided cope until you've talked to an NVDA employee about AI. I'm not even against AI. It's just that a combination of intense financial incentives around a product that provides a good simulation of the Chinese Room has really fucked peoples brains up.
- Simon321 4mo agoThese are the consequences of fear mongering as hard as they did. You reap what you sow. Now they need to convince the government that they didn't mean anything of the previous things they claimed.
- thewebguyd 4mo agoOpenAI is also guilty of excessive fear mongering (remember GPT 2 is too dangerous to release?) This isn't 100% Anthropic's fault, although I'm sure that's part of it. This is the current corrupt administration executing on a grudge they have against Anthropic, and the government's new found love of picking winners and losers.
- yifanl 4mo agoOpenAI is much more eager to jump on board with the administration than Anthropic is, Altman is a lot of things, but he definitely knows which wheels need grease.
- hgoel 4mo agoI don't really think they're acting on a grudge against Anthropic here, I think it really is on Anthropic for describing the model's capabilities the way that they did. IIRC Anthropic claimed to have been working with the government on securing things with Mythos, but then they seemed to have been blindsided by this. My read is that the guys making the decision to restrict it were not the ones that Anthropic had been working with, and it's more about Anthropic getting caught between infighting within an incoherent government.
- 0l 4mo ago> remember GPT 2 is too dangerous to release FYI, this was when Dario was still at OpenAI.
- lompad 4mo agoThat was dario amodei as well, when he was still at openai. He is the primary "create hype by claiming you're dangerous"-guy.
- theplumber 4mo ago[flagged]
- yreg 4mo ago
- moralestapia 4mo ago"Nicholas Carlini recently rang the alarm about the dangers of AI—and now he’s part of a team arguing for the latest models to be released" Many such cases, he was just hungry.
- cmiles8 4mo agoThe AI labs look rather naive here. You can’t jump up and down screaming how amazing, powerful, and dangerous your new tech is and then act surprised and annoyed when the government shows up looking to regulate it. Their new argument now seems be that this was marketing hype/fluff that backfired, in a pretty obvious and predicable way, and now they’re trying to reset the conversation.
- tennfown 4mo agoI’m way more concerned about the loons willing to throw absurd amounts of money at the clearly naive individuals.
- xeonmc 4mo ago[flagged]
- cyanydeez 4mo agoNo. They got caught in a change in what it means to be "regulated". Regulation in a functional democracy: Cool, lets figure this out, write up a bill for us, do some research in congress, lets find something that makes sense. Regulation in a function fascism: Cool, wheres my bribe? My boots not shiny, lick it till I say stop. See, Anthropic wasn't licking enough boot when Biden got discharged and they thought Amazon and OpenAI and Elon were just going to let them capture a market without fealty to the boot.
- voidfunc 4mo agoThis. Theres a lot of rude awakenings in the future for corporate executive types. They are no longer driving the train. Oh well.
- redsocksfan45 4mo ago[dead]
- calvinmorrison 4mo ago[flagged]
- tiahura 4mo agoThey need to send lobbyists not hackers.
- trhway 4mo agoThey should have taken money from Thrive Capital.
- winstonp 4mo agoThey are absolutely clueless about how to talk to this administration.
- fnordsensei 4mo agoYes, why not resolve it the same way all the others have done? Say that Trump has weird elbows or something, Trump sues for defamation, they settle, bribe completed.
- jasonlotito 4mo ago[flagged]
- yieldcrv 4mo ago[flagged]
- yeeetz 4mo agoThey needed to have administration insiders on their team months if not years ago, not just now OpenAI, Meta, SpaceX are savvy enough to play ball, but Anthropic's public posturing and government affairs has always seemed too aloof and intellectual
- thewebguyd 4mo agoTo be fair to Anthropic for a moment (not that they deserve it), but requiring administration insiders and the greasing of palms going on should not continue to be the normal expectations of how to do business in the USA. I'm on the side of any company that refuses to capitulate to this administration. Not saying Anthropic doesn't (because they do), but let's not pretend like the blatant corruption going on should be normalized. Every single citizen should be appalled at this behavior and blatant market manipulation.
- BoorishBears 4mo agoCan you imagine how cringe it would be setting up that hero image in office?
- lelandfe 4mo agoI’m sure it wasn’t the intent but the halo really makes him look like a saint
- BoorishBears 4mo agoFeels very much intended.
- sigmar 4mo ago>Some administration officials have said that a resolution should include an acknowledgment on Anthropic’s part that its rollout of Fable and communication with the White House could have been improved, people familiar with the talks said. >followed initial frustration Friday among some administration officials when they couldn’t immediately get Amodei on the phone, the people said. That he didn't drop everything to talk to them seems like the major crux? But Dario doesn't even do the day-to-day operations Daniela does. Feel like Anthropic should just hire Dean Ball to be their liason or something
- theplumber 4mo agoI feel Dario did enough harm. I wonder if he can do the right thing and step down. It’s really just tiresome to follow all his PR/Hype/warnings and this fiasco makes everything he says seem so silly. At the same time he’s dangerous for the industry. In the end he may get more regulation than he asked for. If the gov decides the Opus models are too powerful without KYC they are toast. And to be honest I think they deserve it.
- bonsai_spool 4mo agoAnd Anthropic say they were on the phone within 15 minutes… This administration is not known for its honesty so it’s hard to take their side of things
- micromacrofoot 4mo agoIt's because the "crisis" is a sham for publicity, like Trump's constant bullshit deals and ceasefires that aren't real, they're just happening to find more problems to keep them in the news.
- jonathanstrange 4mo agoI'm tired of this story and the corresponding fake discussions because it's completely obvious that Anthropic was singled out because they didn't play along with the current US administration and this whole charade is just part of an extortion scheme.
- james2doyle 4mo agoHad to disagree with that. However, I don't think you can discount how much Anthropic has been banging the drum about how AI is dangerous (specifically theirs) and an existential threat, etc. etc. The rollout of Mythos was clearly manufactured to stoke the fears of companies that didn’t have access to it. They also bragged (for Fable) about how they "ran an external bug bounty that produced no universal jailbreaks in over 1,000 hours of testing" only for it be circumvented almost immediately. So them standing on the high horse and saying it is _so powerful, yet so safe_ only to have that blow up in their face just made it that much easier to make an excuse to do this. Again, not disagreeing, but they made themselves the tall poppy here.
- JohnnyMarcone 4mo ago> They also bragged (for Fable) about how they "ran an external bug bounty that produced no universal jailbreaks in over 1,000 hours of testing" only for it be circumvented almost immediately. Where did you see there was a universal jailbreak? How do you weigh the DOD fight against warning about Mythos' dangers when determining what made Anthropic 'the tall poppy'?
- eiejeqq 4mo agoAre people here deluded? Business 101 - never take on an entity who has ultimate power over you and can conduct a course of action to put your existence at threat
- SpicyLemonZest 4mo agoPeople here aren’t authoritarians, so we don’t accept your premise that you shouldn’t take on the government. That’s not how things work in the US. Perhaps you’ve encountered Trumpists who tell you that it is, but they’re lying; they routinely applaud businesses defying any government which their dictator-in-chief doesn’t control.
- FergusArgyll 4mo agoUnrelated to this story but Carlini rocks. tic tac toe in printf https://github.com/carlini/printf-tac-toe https://github.com/carlini/printf-tac-toe Recently Regex Chess: A 2-ply minimax chess engine in 84,688 regular expressions https://github.com/carlini/regex-chess https://github.com/carlini/regex-chess https://news.ycombinator.com/item?id=48136909 https://news.ycombinator.com/item?id=48136909
- FergusArgyll 4mo agoI think headline readers might have thought I meant completely unrelated. It's not. Read the article...
- matheusmoreira 4mo agoAll the government has to do is simply pull up the blog posts of Anthropic's own CEO.
- slopinthebag 4mo ago[flagged]
- tomhow 4mo agoCould you please stop posting unsubstantive comments and flamebait? You've unfortunately been doing it repeatedly. It's not what this site is for, and destroys what it is for. If you wouldn't mind reviewing https://news.ycombinator.com/newsguidelines.html https://news.ycombinator.com/newsguidelines.html and taking the intended spirit of the site more to heart, we'd be grateful.
- slopinthebag 4mo agoMy bad, I will do better. I know you guys are spread pretty thin managing the site, so I went through the comments for this post and collected some other comments which are also probably breaking site rules. https://news.ycombinator.com/item?id=48576022 https://news.ycombinator.com/item?id=48576022 https://news.ycombinator.com/item?id=48576065 https://news.ycombinator.com/item?id=48576065 https://news.ycombinator.com/item?id=48576162 https://news.ycombinator.com/item?id=48576162 https://news.ycombinator.com/item?id=48576183 https://news.ycombinator.com/item?id=48576183 https://news.ycombinator.com/item?id=48575948 https://news.ycombinator.com/item?id=48575948 https://news.ycombinator.com/item?id=48575697 https://news.ycombinator.com/item?id=48575697 https://news.ycombinator.com/item?id=48575877 https://news.ycombinator.com/item?id=48575877 https://news.ycombinator.com/item?id=48576280 https://news.ycombinator.com/item?id=48576280 https://news.ycombinator.com/item?id=48576241 https://news.ycombinator.com/item?id=48576241
- tomhow 4mo agoSome are, some aren't, but could you please just flag comments that break the guidelines, or if they're particularly egregious, email us (hn@ycombinator.com).
- ofjcihen 4mo agoGenuinely hilarious reply. On that note it would be interesting to do a sentiment analysis of flagged replies. They seem all over the place and it would be interesting to see if there were any biases.
- rurban 4mo agoCarlini rocks, but they should have definitely NOT sent him. He will them too much, and they'll find even more excuses to block us. This needs an experienced negotiator, ie. a manager
- catigula 4mo ago>Nicholas Carlini recently rang the alarm about the dangers of AI—and now he’s part of a team arguing for the latest models to be released Classic Anthropic.
- spacebacon 4mo ago[dead]
- robgibbons 4mo agoThis export ban follows Anthropic refusing to provide uninhibited use of AI to the US military, and the Pentagon subsequently listing them as a supply chain threat. That in turn led to Anthropic suing the government. This most recent development is obviously just a vindictive administration doing what it can to blackball Anthropic for not kowtowing to unrestricted military use like all of the other AI giants.
- sharts 4mo agomarketing shouldn’t exist. always exaggerated claims, half-truths.