4 ms·
Anthropic was founded by exiles of OpenAI's safety team, who quit en masse about 5 years ago. Then a few years later, the board tried to fire Altman. When will
by leoh 11mo ago
Anthropic was founded by exiles of OpenAI's safety team, who quit en masse about 5 years ago. Then a few years later, the board tried to fire Altman. When will folks stop trusting OpenAI?
- kotaKat 11mo agoWhen the justice system finally catches up and puts Sam behind bars.
- JumpCrisscross 11mo ago> When the justice system finally catches up and puts Sam behind bars Sam bears massive personal liability, in my opinion. But criminal? What crimes has he committed?
- venturecruelty 11mo agoI'm sure we could invent one that sufficiently covers the insane sociopathy that rots the upper echelons of corporate technology. Society needs to hold these people accountable. If the current legal system is not adequate, we can repair it until it is.
- JumpCrisscross 11mo ago> If the current legal system is not adequate, we can repair it until it is Sure. Relevant for the next guy. Not for Sam.
- danny_codes 11mo agoJustice can come unexpectedly. There was a French revolution if you recall. Ideally we will hold our billionaire class to account before it gets that far, but it does seem we're trending in that direction. How long does a society tolerate sociopaths doing whatever they want? I personally would like to avoid finding out.
- JumpCrisscross 11mo ago> There was a French revolution The elites after the French Revolution were not only mostly the same as before, they escaped with so much money and wealth that it’s actually debated if they increased their wealth share through the chaos [1]. If we had a revolution in America today–in an age of international assets, private jets and wire transfers--the richest would get richer. This is a self-defeating line to fantasize on if your goal is wealth redistribution. [1] https://news.ycombinator.com/item?id=44978947 https://news.ycombinator.com/item?id=44978947
- myvoiceismypass 11mo ago> How long does a society tolerate sociopaths doing whatever they want Tens of millions of Americans not only voted for a sociopath who does whatever he wants from the billionaire class, they also wear cute little hats and drive cars with bumper stickers cheering on said sociopath.
- Me1000 11mo agoClaude has a sycophancy problem too. I actually ended up canceling my subscription because I got sick of being "absolutely right" about everything.
- p1necone 11mo agoI've had fun putting "always say X instead of 'You're absolutely right'" in my llm instructions file, it seems to listen most of the time. For a while I made it 'You're absolutely goddamn right' which was slightly more palatable for some reason.
- ethin 11mo agoI've found that it still can't really ground me when I've played with it. Like, if I tell it to be honest (or even brutally honest) it goes wayyyyyyyyy too far in the other direction and isn't even remotely objective.
- p1necone 11mo agoYeah I tried that once following some advice I saw on another hn thread and the results were hilarious, but not at all useful. It aggressively nitpicked every detail of everything I told it to do, and never made any progress. And it worded all of these nitpicks like a combination of the guy from the ackchyually meme (https://knowyourmeme.com/memes/ackchyually-actually-guy https://knowyourmeme.com/memes/ackchyually-actually-guy) and a badly written Sherlock Holmes.
- im3w1l 11mo agoMy advice would be: It can't agree with you if you don't tell it what you think. So don't. Be careful about leading questions (clever hans effect) though. So better than "I'm thinking of solving x by doing y" is "What do you think about solving x by doing y" but better still is "how can x be solved?" and only mention "y" if it's spinning its wheels.
- Applejinx 11mo ago
- hereme888 11mo agoWhen valid reasons are given. Not when OpenAI's legal enemy tries to scare people by claiming adults aren't responsible for themselves, including their own use of computers.
- titanomachy 11mo agoThis argument could be used to support almost anything. Gambling, fentanyl, slap fighting, TikTok…
- Dilettante_ 11mo ago"Yes."
- danny_codes 11mo agoI mean we could also allow companies to helicopter-drop crack cocaine in the streets. The big tech companies have been pretending their products aren't addictive for decades and it's become a farce. We regulate drugs because they cause a lot of individual and societal harm. I think at this point its very obvious that social media + chatbots have the same capacity for harm.
- fragmede 11mo ago> We regulate drugs because they cause a lot of individual and societal harm. That's a very naive opinion on what the war on drugs has evolved to.
- gizmodo59 11mo agoAnthropic emphasizes safety but their acceptance of Middle Eastern sovereign funding undermines claims of independence. Their safety-first image doesn’t fully hold up under scrutiny.
- danny_codes 11mo agoIMO the idea that an LLM company can make a "safe" LLM is.. unrealistic at this time. LLMs are not very well-understood. Any guardrails are best-effort. So even purely technical claims of safety are suspect. That's leaving aside your point, which is the overwhelming financial interest in leveraging manipulative/destructive/unethical psychological instruments to drive adoption.
- QuadmasterXLII 11mo agoThere’s a close tangle between the problems that we don’t know how to build a company that would turn down the opportunity to make every human into paperclips for a dollar; and no one knows how how to build a smart AI and stil prevent that outcome even if the companies would choose to avoid it given the chance.
- nullbio 11mo agoWhen will folks stop trusting Palantir-partnered Anthropic is probably a better question. Anthropic has weaponized the safety narrative into a marketing and political tool, and it is quite clear that they're pushing this narrative both for publicity from media that love the doomer narrative because it brings in ad-revenue, and for regulatory capture reasons. Their intentions are obviously self-motivated, or they wouldn't be partnering with a company that openly prides itself on dystopian-level spying and surveillance of the world. OpenAI aren't the good guys either, but I wish people would stop pretending like Anthropic are.
- khafra 11mo agoAll of the leading labs are on track to kill everyone, even Anthropic. Unlike the other labs, Anthropic takes reasonable precautions, and strives for reasonable transparency when it doesn't conflict with their precautions; which is wholly inadequate for the danger and will get everyone killed. But if reality graded on a curve, Anthropic would be a solid B+ to A-.