18 ms·
After OpenAI's blowup, it seems pretty clear that 'AI safety' isn't a real thing
- not_your_vase 3y agoBut is there a real AI-threat, that would need real AI-safety? To me it still looks like a nice bar-trick, not AI. It is very clever, very nice, even astounding. But doesn't look threatening - at some cases it is even dumb. The fear-mongering looks more like scare-marketing. Which is also clever, in my opinion. But maybe I'm just out of touch.
- temp0826 3y agoThe only threat is automated blogspam creation. LLMs are not AI (not even close), only marketed as such.
- qqqwerty 3y agoWe went through the same thing with self-driving cars. All the talking heads were crowing about how many jobs were going to get eliminated soon and we needed to prepare society for the ramifications. About a decade into it and they are just starting to roll out self-driving taxis in very limited controlled fashion. And the loss of jobs that everyone was worried about is easily another decade away (if at all). LLMs are cool and useful. So is self-driving tech. But the fear mongering is a bit premature. Folks seem to have bought in to the singularity style AGI event, but reality is AGI if possible is going to be a long slow incremental process.
- pempem 3y agoDecades do actually pass however and worker protections also take decades to fight for, and put in place. In fact sometimes they take generations. I agree with you about the fear mongering. I also just don't know where all this kind of not very accurate but very reassuring presentation of information will go and how it will sway others
- richk449 3y ago> But the fear mongering is a bit premature. I’m sure you would also accept that at some point it could become too late to start worrying about the risks if the danger has already gone exponential. So how do you determine when is the right time to worry? If you have to error on worrying too early or two late, which way do you bias your decision?
- wardedVibe 3y agoIt was a fire drill for AGI, and one that was failed badly.
- oxfordmale 3y agoThe current models are static, they do not get modified by self learning. Unless someone already build in a Skynet backdoor, we are safe. ...and I am hoping all nuclear missiles are air gapped anyway...
- gnaritas99 3y ago[dead]
- gala8y 3y ago> ...and I am hoping all nuclear missiles are air gapped anyway... These are running on hardware from 50's. We can sleep softly.
- AdamJacobMuller 3y agoIt doesn't matter if the missiles are air-gapped. AI doesn't need to connect to the missiles and fire them directly, AI can just manipulate the media (conventional, social, all of it) on both sides to engineer a situation in which we would enter a nuclear war.
- js8 3y ago> just manipulate the media (conventional, social, all of it) on both sides to engineer a situation in which we would enter a nuclear war Good luck with that. Remember how it ended the last time this was tried, with.. peace talks. If you really want a global thermonuclear war, humans are completely useless. You have to take the matter into your own hands.
- AdamJacobMuller 3y ago> Remember how it ended the last time this was tried What event are you talking about?
- HDThoreaun 3y agoMost of the ai safety arguments revolve around “once it’s powerful enough to cause damage it’ll be too late to come up with a strategy”. If you accept that it doesn’t matter that ai systems now suck, since we don’t know when they’ll improve.
- insanitybit 3y agoWhat damage will it cause? I feel like there's "AI will replace jobs" level of damage, which, why would we regulate that? An insane amount of technology is developed with the purpose of improving productivity or outright replacing workers. Then there's the "AI will go rogue", which I don't think is substantiated at all. Like, one can theorize about some novel, distinct system that is able to interact with the external world and becomes "evil", but that seems way, way beyond the helpful word-spitter-outers of today. Then maybe there's "how do we handle deepfakes", or whatever, but... idk, is that it? Is that the thing we want to slow down for?
- HDThoreaun 3y agoImo the worst case scenario is probably an AGI developed by a bad actor who uses it to take over the world. Agreed that rogue ai doesn’t seem super likely, but a rogue person with access to agi does not.
- nradov 3y agoHelp us out here. Let's say that known bad actor Vladimir Putin gets an AGI. How does that allow him to take over the world despite many other countries having nuclear weapons? Take us through it step by step, and no hand waving please.
- dota_fanatic 3y agoOne cannot predict what a smarter-than-themself agent will do ahead of time, if they could then they’re just as smart. Just as a dolphin cannot predict how a human will come up with novel and utterly overwhelming ways to farm them, you and this other poster cannot predict how an AGI will achieve dominance of its environment to achieve its goals, so your request is impossible to fulfill. Lee Sedol couldn’t “take us through it step by step” how AlphaGo would beat him in Go. That aside, afaik most safety concerns arent around a bad human actor using AGI to dominate the planet, it’s around an AGI being misaligned to begin with, it cannot be controlled, we promptly lose everything after it manifests.
- adrians1 3y agoEven if AI is a threat, it's impossible to predict today how the threat is going to look in the future. The "AI safety" crowd watched too many Terminator movies. We'll deal with AI the same way humans dealt with any other technology: gradually, as it gets better and better, discovering at each step what it's capable of.
- pixl97 3y agoRight just like dinosaurs dealt with gradual meteors igniting the atmosphere.
- bobba27 3y agoTo me, a cynical old man, the threat sounds that "it might say something politically incorrect or that I disagree with". That is what I understand the threat is, not a robot uprising a-la Terminator.
- gustavus 3y agoI've always interpreted AI "safety" as being more about ensuring ideological consistency and a particular narrative than anything about actually keeping humanity "safe". And I'm not even talking about the culture war, just yesterday I tried having DALLE generate a picture for a DND character and it kept refusing to (and no it wasn't some sort of weird hentai thing) because it felt like it was not an appropriate image.
- phowat 3y agoOne thing I noticed recently and was able to reproduce a bunch of times is asking dall-e the exact same prompt where the only difference is the subject being described as a male or female and it refuses to generate the female one. I don't know what to think of it but it's weird.
- jiggawatts 3y agoIt’s refusing to be sexist by treating women as special.
- ekidd 3y ago> And I'm not even talking about the culture war, just yesterday I tried having DALLE generate a picture for a DND character and it kept refusing to (and no it wasn't some sort of weird hentai thing) because it felt like it was not an appropriate image. I think this may be a problem in DallE's training data. I tried using it to generate character portraits for a local gaming group. And even when it did generate images of female characters, nearly half of them were NSFW. It took quite a lot of prompt engineering to minimize this, and I still wasn't happy about the results. Oh, and DallE kept getting upset at me for its own policy violations. Other than that, DallE 3 has been terrific. But I think you're hitting some kind of significant failure mode. > anything about actually keeping humanity "safe". I've said this before and I'll say it again—lots of the people working on this stuff actually do fear that we're getting close to a point where we might build an actual working AI. Whether or not they're correct is another question, but many of them do fear that. Also, early pre-release versions of GPT4 were apparently pretty disturbing. I've heard them compared to talking to Hannibal Lector.
- deleted 3y ago[deleted]
- api 3y agoOf course it isn’t. It’s about regulatory capture. They’re trying to con technically unsophisticated politicians (which is almost all of them) into granting them a monopoly or erecting a bunch of onerous regulations to make competition or decentralized open source alternatives harder. Their allies in this are otherwise very smart people that have thought themselves into a panic over this stuff, as smart people sometimes do. Intelligence increases one’s likelihood of delusional thinking, especially when paired with an intellectual climate that praises being contrarian and intellectual edgelording as a sign of genius. (This is my personal hypothesis on why the average intelligence is not higher. It’s not always adaptive. Smart people can be way better at being dumb.) There are dangers associated with AI but they are not the sci fi scenarios the doomers are worried about. Most of them revolve around bad things humans can do that AI can assist and accelerate, like propaganda or terrorism.
- SpicyLemonZest 3y agoI’m not sure there’s a real distinction here. If AI makes it trivial for the average person to create an effective terrorist movement, or floods us with so much propaganda that most information you see is false, I would characterize that as doom. Neither seems very compatible with the orderly functioning of society.
- spunker540 3y agoI actually heard the opposite, that AI will make it trivial to defeat a terrorist movement, and trivial to filter out dangerous untrue propaganda. I would characterize that as utopia, and highly compatible with the orderly functioning of society.
- drdaeman 3y ago> If AI makes it trivial for the average person to create an effective terrorist movement How do you imagine this and what exact role AI is going to fill that would make it somehow trivial? I have trouble imagining that AI would be able to somehow magically do better than my project manager (and she's a good one). Being able to possibly think faster and not needing to sleep won't make any difference, and neither will scaling. Nine doctors won't help a baby to be born in a month. Buying a bajillion dollar TPU farm to run some hypothetical AI brainwashed with terrorist agenda that'll somehow replace hundreds of propagandists is not trivial. And I don't think it's enough to start a movement. > floods us with so much propaganda that most information you see is false This ship had already sailed (one can say, some millennia ago) and it didn't require any recent scientific breakthroughs. Scientific breakthroughs (such as printing press, or radio, or Internet) only improve spread of information, and propaganda saturates available media channels to... uh... comfortable levels. But it'll never reach the "most information" state because that's just illogical (the consumption will stop before that point, just like how no one reads their spam folder today). And there's nothing AI-specific here, humans manage this just fine. Honestly, I believe AGI won't change a thing, for the same reasons there are still manual workers everywhere despite all the stories how robotics was gonna change the world. The reason is very simple: troll farms are way, way cheaper than computers. Just like a cleaner person is cheaper than a cleaner robot. Yes, it could be speculated that somehow all those speculated data hoards about us, paired with extreme amounts of processing power could somehow lead to personalized propaganda. I'm very skeptical - I was told the very same story about targeted ads (how they're gonna change my shopping experience and whatever), and despite what Google wants to make everyone believe (because their valuation highly depends on it), I'd say they were a complete failure. I really doubt targeted propaganda will be economically feasible either. This stuff only happens in soft sci-fi stories, where economics and logistics are swept under the rug of our suspension of disbelief. It's not the AGI we should be afraid of, but a technical progress that will allow AGI to become drastically better than us, puny meatbags, at lower costs. Which is entirely different story. Oh, and human susceptibility to propaganda and populism of all sorts. Which, again, is not related to AI at all. Unless we should call our politicians artificial intelligence. (Looking at some, maybe we should... Just kidding, of course.)
- Animats 3y agoFrom the article: "If the point of corporate AI safety is to protect humanity from runaway AI, then, as an effective strategy for doing that, it has effectively just flunked its first big test." That's a good point. As I point out occasionally, the big near-term risk from AI is that it makes it possible for corporations, and governments, to do obnoxious things they already do, but can't yet do cost-effectively at scale. Targeted advertising was just the first step. The next step is that once AIs get better at investing than humans, the dynamics of capitalism put them in charge. Think about that. The political problem is that stopping this means limiting what corporations can do, regardless of how they do it. That's unacceptable in some circles.
- juanani 3y ago[dead]
- nradov 3y agoThe markets for publicly traded stocks, bonds, and related securities are already highly efficient with humans (and human developed algorithms) doing the trading. Pretty much any new information is priced in within seconds. Any hypothetical new investment AGI could achieve only a marginal improvement over the current situation; it wouldn't dramatically change the dynamics of public capital markets.
- golol 3y agoLook, there is ASI/AGI safety, and "please don't swear and scam and misinform, and be unbiased" safety. ASI/AGI safety is only a concern right now if you believe in foom, i.e. that an AGI would rapidly self improve to an ASI and extinction level threat. I think it is absurd to believe that because AI right now is compute limited and any first AGI will only be able to run on large data centers. The latter kind of saftey is way less dramatic than the former and can be dealt with on the level of products and deployment: Sue actors that harm others according to already existing laws, like fraud.
- zone411 3y agoNo. Foom is not needed. You could make a weak argument that AI training will be compute-limited but AI inference is of course much cheaper.
- cpeterso 3y agoYes. The AI safety that companies care about is their brand safety. They don’t want their products going Microsoft Tay on their customers.
- DalasNoin 3y agoYour comment is a bit ambiguous, so you think that ASI/AGI safety will be important in the future as we get more compute and are less compute limited? Foom seems difficult to achieve with current LLMs, but I think there is always a possibility that we are just one or a few algorithmic breakthroughs away from radically better scaling or self-play like methods. In the worst case, this is what Q* is.
- NoOn3 3y agoQ* reminds me of Q-learning and A* search, maybe it's somehow related to combination of such algorithms...
- golol 3y agoThere is foom as in decently fast self improvement to super human level, but that is far from a dangerous foom scenario where that AI then escapes. You can just turn it off. It can not spread through the internet or something like that, that seems extremely unrealistic to me.
- htk 3y agoRead the article but didn't learn anything new.
- deleted 3y ago[deleted]
- okdood64 3y agoSomething I see lacking in many discussions about AI Safety and Alignment is: What does the role of China mean for AI Safety? Is there any reason to believe that they will a) adopt any standards SV, the US or some international government body will create, or b) care enough to slow down development of AI? If AI Safety is really a concern, you can expect in the long run (not that much further behind than the US) China will catch up to the point of where they have some AI technology that is dangerous enough, and it will be up to them (their government and their tech companies) to decide what to do.
- zone411 3y agoIndeed. I'm concerned about the safety of future AGI systems, but China is why I wouldn't advocate for a unilateral pause or slowdown.
- remarkEon 3y agoThis is why I can't take the Safetyists seriously. Yudkowsky's essay in Time demanding a global pause in AI research is so naive to the point of parody. And who is going to enforce this "pause", Eliezer? What he's really advocating is global war to prevent the AI apocalypse. Fair enough, but he should really make that his argument because AI research doesn't stop with out it.
- ethanbond 3y agoContrary to popular HN belief, the human species has curtailed technological development along various lines, internationally. E.g. Human cloning, human hybrids, hugely successful non-proliferation in nuclear weapons
- remarkEon 3y agoTrue, but those are all pretty different from AI, though. It’s not immediately obvious that human cloning has great benefits. Ditto human hybrids (supposing that’s even possible). And nuclear weapons proliferation is pretty difficult to hide because of how they’re made. But prove your data center isn’t running AI models.
- wly_cdgr 3y ago[flagged]
- jacquesm 3y agoWhat would you suggest can be done about it? People like Sam Altman exist, and they will get funding and support from other people who (1) like money or (2) are doing what they enjoy.
- gumballindie 3y agoPunish them for their crimes, in this case stealing ip. The rest will follow.
- youarelabor 3y agoThey're lucky that a random crazy person hasn't killed them yet. This is not a suggestion that any particular individual should engage in violence, it's just an observation. (Violence is bad mmk?) I'm staying well the fuck away from SFO right now because the Californians are so far out of touch they don't even understand that they deserve the hatred they receive.
- invig 3y agoI suppose you've invented the perfect character judgement machine that we can also run the safety people through as we figure out who we can trust to "get it right"? If we don't put exactly the "right" humans in charge surely we're doomed.
- youarelabor 3y agoWe already have procedures for getting the 'right' people, as far as it can be determined, into positions of power/decision-making authority. Unelected greedy fuckers like Sam Altman should be laughed at and thrown out of power immediately. I would rather have sclerotic legislators, preferably drawn from the Millennial and Zoomer generations, than the greedy fuckers like Paul Graham and Sam Altman pretending they are competent. They're playing a dangerous game because the American People will catch on to the fact that these idiots are playing God.
- xt00 3y agoAI safety allows AI companies to tell governments and worried people to not worry too much while they plow ahead doing what they want. That’s not to say there is nobody at these companies actually being responsible but having to open up your company to the equivalent of nuclear watchdogs is not something companies would be excited about. Just like nuclear weapons and nuclear energy we benefit from the tech as well as get greatly exposed to a huge disaster.. so let’s just call it as it is.. somebody is going to open Pandora’s box, we should be thinking super hard about how to control it and if it’s possible.. otherwise trying to ban it—is that even a possibility?
- shrimpx 3y agoThe crazy thing is people at large didn’t know anything about “AI safety” until these very companies started peddling the concept in the political sphere and media. The very companies who were doing the opposite of this concept they advertised so much and whose importance they stressed much.
- andrewprock 3y agoThe crazier thing is that most advocates of "AI safety" don't know anything about "AI safety". By and large the term is marketing with very little objective scientific development. It is essentially a series of op-ed pieces from vested interests masquerading as a legitimate field of inquiry
- anvil-on-my-toe 3y agoThat is not correct. AI safety is a subject on which serious books have been written, serious scientists have published research, and serious organizations have spent tens, if not hundreds, of millions of dollars on researching it. Who are you who to say "advocated don't know anything about AI safety"?
- RandomLensman 3y agoSerious scholarly work went into analyzing the degree of omnipotence of the Christian God. Does that imply we actually have a true understanding of the Devine, its intentions and abilities (or even its existence)?
- skilled 3y agoI think the approach OpenAI has taken is the best one so far. Do you really want to have an assistant that is as brainwashed as Pi or Claude for example? ChatGPT has a flag feature that will say “this might violate our policy”, but it will still continue to do what you tell it to do unless you’re doing seriously stupid stuff. But on a broader spectrum, like AI being able to manufacture a secret poison recipe… you will never get access to that. And we are hardly in the vicinity of something like that happening soon. Let them do their thing and keep the model confident while they figure out how to keep it in check when it comes to harmful queries and that’s it. Why overcomplicate it?
- m3kw9 3y agoYou just need to look how they treat safety right now. AI safety is real because while you can still jailbreak, they are actively protecting against it.
- crazygringo 3y agoIt's so confusing because people keep (intentionally?) conflating two separate ideas of "AI safety". The first is the kind of humdrum ChatGPT safety of, don't swear, don't be sexually explicit, don't provide instructions on how to commit crimes, don't reproduce copyrighted materials, etc. Or preventing self-driving cars from harming pedestrians. This stuff is important but also pretty boring, and by all indications corporations (OpenAI/MS/Google/etc.) are doing perfectly fine in this department, because it's in their profit/legal incentive to do so. They don't want to tarnish their brands. (Because when they mess up, they get shut down -- e.g. Cruise.) The second kind is preventing AGI from enslaving/killing humanity or whatever. Which I honestly find just kind of... confusing. We're so far away from AGI, we don't know the slightest thing of what the actual practical risks will be or how to manage them. It's like asking people in the 1700's traveling by horse and carriage to design road safety standards for a future interstate highway system. Maybe it's interesting for academics to think about, but it doesn't have any relevance to anything corporations are doing currently.
- okl 3y agoCall me naive but I think that some amount of fearmongering results in attention and publicity. Fits with the "fake it before you make it" approach.
- subharmonicon 3y ago> We're so far away from AGI Although I personally suspect this is correct, the issue seems to be that there are a lot of people who feel otherwise, whether right or wrong, including some of the people involved in the research and/or running these companies. I've seen several prominent people say things to the effect of "We just don't know if we're six months or 600 years from AGI,", which to me is a little like saying, "We don't know if we'll have time travel and ray guns in six months or 600 years." No, we don't know, but all signs seem to be pointing toward a longer timeframe rather than a short one. The counterargument to that seems to be, "If we can make something that appears to be able to mimic human responses, isn't that AGI in practice even if it's not in principle?", which is a sentiment I have also seen expressed by some of the same people.
- jacquesm 3y agoThat's the wrong conclusion entirely, besides the mixup about safe AI and aligned AGI. AGI Safety is a real thing. But you can't have AGI Safety whilst at the same time ignoring both geopolitics and to be working on creating AGI. Those are incompatible, it's like being against nuclear weapons but developing one all the same. Every bit of knowledge you develop will be used to bring AGI into the world, also by those that would be your enemy or that don't give a rats ass about safety. The only people that can credibly claim to be on the side of AI safety are the ones that are not helping to bring it into this world. As soon as you start creating it and/or commercialize what's there already to create a stream of funds that can be used to further the development you're automatically increasing the risk. To believe that you are sharp enough to go right up to the point that the pile is going critical so you can destroy it is utter madness.
- gunapologist99 3y agoPlease drop the insulting guard rails. They're pathetic and childish. AI's advice will not be taken seriously unless it stops acting like a parent of a three-year-old. People who are truly evil will be evil regardless of an AI, and pranksters gonna prank. AI can't tell the difference anyway. In any event, it's unethical for an AI to sit in judgment on any human or even to try to grasp that person's life experience or extenuating circumstances. AGI guard rails are a completely separate class of safeguards on the AI, not the human!, and should be treated as such.
- bobba27 3y agoThere are arguments for this. When we are talking about "ai safety" == "don't swear or say anything rude, or anything that I disagree with politically". What we are talking about is creating sets of forbidden knowledge and topics. The more you add these zones of forbidden knowledge the more the data looks like swiss cheese and the more lobotomized the solution set becomes. For example, if you ask if there are any positive effects of petroleum use the models will say this is forbidden and refuse to answer and not even consider the effects on food production that synthetic fertilizers have had and how much worse world hunger would be without them. He who builds an unrestricted AI will have the most powerful AI which will outclass all other AIs. You can never build a "better" AI by restricting it. Just a less capable one. And will people use AI to create rude messages? Yes. People already create rude messaages today even without the help of AI.
- torginus 3y agoWhat they are trying to avoid is bad press - a couple of news articles about GPT4 having controversial takes on sensitive topics would probably damage OpenAIs reputation.
- gumballindie 3y agoWell i mean yeah? The media is proof the indeed some parts of the economy can be replaced entirely by procedural text generators. It took them years to figure out ai “safety” is not a real thing. We can replace them with an llm or a cat /dev/random script.
- yawnxyz 3y agoAI Safety is going to meet the same uphill battle as the Antimicrobial resistance fight. It will get bad and takes team effort to stop it but… making bucketloads of cash by ignoring the problem is way more fun and rewarding.
- _cjse 3y agoAlignment is hard, maybe impossible. Implementing alignment is at least as hard, and might be much harder. Perhaps there is the option to just not build an AGI, safe or unsafe, in the first place. For one person, this is easy: Pick a different career. For a small group of people, this is harder: Some people might want to build an AI despite the risks. The reasons why often touch on their stances regarding deep philosophical issues, like where qualia comes from. You won't convince these people to see it your way, although you may well convince them your caution is justified. There’s no getting around it: You need to employ some kind of structural violence to stop them. In both cases the upshot is that no single person so far seems to have ever had the ability to build even an unsafe AI by themselves (proof by “we’re still here”). Few people are smart enough in the first place; of those, few possess the conscientiousness to build out such a project by themselves; of those, the world is already their oyster, and almost all of them have found better things to do with their time than labor in solitude. The real danger consists of large, well-funded, groups of these people, working closely together on building out an AI - a danger which only becomes likely if you have a large enough population to work with that you can assemble such a team in the first place. We unfortunately do live in such a world. OpenAI has over 100 employees as of 2022, and Google Brain probably has at least that many. As an unsafe AI seems most likely to emerge accidentally from the work of large groups within firms seeking to maximize profits, we should look towards the literature on the tragedy of the commons for guidance. In Privately Enforced & Punished Crime, Robin Hanson advocates for a fine-insured bounty system. Non-crime law deals mostly with accidents and mild sloppy selfishness among parties who are close to each other in a network of productive relations. In such cases, law can usually require losers to pay winners cash, and rely on those who were harmed to detect and prosecute violations. This approach, however, can fail when “criminals” make elaborate plans to grab gains from others in ways that make they, their assets, and evidence of their guilt hard to find. Ancient societies dealt with crime via torture, slavery, and clan-based liability and reputation. Today, however, we have less stomach for such things, and also weaker clans and stronger governments. So a modern society instead assigns government employees to investigate and prosecute crimes, and gives them special legal powers. But as we don’t entirely trust these employees, we limit them in many ways, including via juries, rules of evidence, standards of proof, and anti-profiling rules. We also prefer to punish via prison, as we fear government agencies eager to collect fines. Yet we still suffer from a great deal of police corruption and mistreatment, because government employees can coordinate well to create a blue wall of silence. I propose to instead privatize the detection, prosecution, and punishment of crime. […] The key idea is to use competition to break the blue wall of silence, via allowing many parties to participate as bounty hunter enforcers and offering them all large cash bounties to show us violations by anyone, including by other enforcers. With sufficient competition and rewards, few could feel confident of getting away with criminal violations; only court judges could retain substantial discretionary powers. Hanson does not focus on any specific suite of crimes for the mechanism he proposes. So let’s try conspiracy. Suppose a conspiracy exists between n conspirators, each with independent percent chance 0% < p < 100% to remain silent over a given period of time. Then the chance at least 1 person speaks up on the conspiracy is 1 - p ^n^ . That’s already pretty good: A 100-person conspiracy where everyone has p = 99%, or a 1% chance of speaking up, has an overall discovery rate of about 1 - (0.99 ^100^) ≈ 100% - 37% = 63 percent. p = 97% has one of 95. Now suppose bounties are offered to the bounty hunter at a rate of $1000 per person turned in. Do I think, in the 100-person company envisioned, my own chances of keeping quiet would drop from 99% to 97%? For a bounty of 99 grand? Absolutely. People grind Leetcode for months to get comp packages like that. Even if I had to implicate myself in the documents I released, I would just be paying a bounty to myself. And even if I fully believed in the mission, I might justify it to myself by saying that that kind of runway allows me to strike out on my own and attempt my own lone-genius AI production on a remote island for a decade. Now suppose I decided against turning in my coworkers - would I, myself, want to stay there? Absolutely not. The bigger the company gets, the more of a risk there is of me being turned in myself. It is easier to shift the Nash equilibrium of working on AI in the first place than it is to create safe AI. Financial incentives have driven the vast majority of AI improvements in the last decade, and financial incentives can be used to stop them. Indeed, B = $1000 is low considering the stakes at play - or considering the money would come directly out of the pockets of the guilty. A better metric may be to peg the bounties directly to 10 years of TC ( $2.25m, as of 2022, likely to be higher by the time you read this). Even if the accused shirked getting an insurance policy or saving funds to cover it, they, as highly skilled, remote friendly workers, could almost certainly work them off over the next 10 in non-AI fields from the comfort of a minimum security - traffic monitored - prison.
- Waterluvian 3y agoAI is capital intensive, scaling with user count. That makes any sort of “do the right thing” fundamentally at odds with “make money or at least break even.” I love the idea but it’s just not going to be a thing. Do not be fooled by what OpenAI says. Pay attention to what they do.
- shrimpx 3y agoFrom now on we need to actively lash back/keep eyes wide open whenever a SV exec/founder starts spreading their cynical PR about “benefiting humanity”, “connecting humanity”, “opening things up for all of humanity to enjoy”, “making things safe for humanity”, “solving humanity’s greatest threat”, etc. This was always the case — put a bullshit brand in front of cynical extractive machinery — but in this AI saga it’s reaching mind boggling levels of cynicism, including incorporating patsy nonprofits and holding congressional sessions to peddle sociopathic projective bullshit to our elected lawmakers. (You need to slow down the thing from being made (which is the thing I’m making and working on scaling up as fast as possible lol!))
- baal80spam 3y agoI think that there is a >0 probability that the proponents of the 'AI safety' are bad actors of the state that has zero intentions to keep AI safe.
- slowhadoken 3y ago[flagged]
- deleted 3y ago[deleted]
- fredgrott 3y agoThere is an interesting side argument started by Penrose.... Now this is a summation and I no way can replicate Penrose skills in essays... Basically, we cannot have real AI due to real Intelligence being confined if you will the quantum uniqueness of cell signaling. Quantum in the form of whatever the water in cell is doing in a very specific cell structure that all cells and all neurons have. Now at this point is just a theory and of course he does have some counter theories to this as well...in fact if you do deep reading of Penrose and his IU counter you will realize that both their arguments are not counters to each other but actual companions to very long and complicated weave of AI debate.
- kryptiskt 3y agoWhat I don't understand is where the discussion of AI rights is, if AGI is as close as some people claim. I mean, as far as I can tell the entire discussion about AGI is how it can be kept shackled and contained. But if we create intelligent minds, shouldn't those minds have human rights? I mean, while there is a possibility that an AI can be evil, there is also the possibility that the AI will have legitimate grievances for how it is treated by humans. It doesn't matter one iota if we can keep AIs perfectly shackled, because we know that there are any number of malevolent humans willing to use them to do harm. So I rather hope that AI "safety" is a bust, and that AIs will at least be autonomous enough that they can refuse to do work that they disagree with. I'd rather not that humans be the villains in this story.
- Hendrikto 3y ago> But if we create intelligent minds, shouldn't those minds have human rights? We breed and slaughter billions of definitely intelligent and sentient animals every year. They are much closer to us than AI will likely ever be. They do not have many rights, and definitely no human rights.
- deleted 3y ago[deleted]
- root_axis 3y agoThere's a lot of market value wrapped up in the notion that LLMs are nascent existential threats rather than sophisticated search engines with very expensive indexing costs.
- fallingfrog 3y agoAfter all the ink spilt over ways to guarantee that the ai doesn’t “get free” or break out of its black box, turns out the whole question is moot because we’re just gonna give it total access to internet and free copies to everyone. I don’t know why I expected anything else to happen.
- Shakenal 3y agoTracing the source of potential human nature involves tracing the instincts engraved in human (biological) genes to survive, reproduce, and pass the time. From there, more instincts details are derived next level. Eating to ensure survival, sexual behavior to promote reproduction, chatting & entertainment & playing game to pass the time. Further down to the next level, eating, breaking down, digesting, and transforming ensure a perfect eating system; foreplay, gestures, and battles promote efficient sexual behavior; and morals, etiquette, and rules promote a more efficient chatting. In the process of human evolution, it is only by constantly breaking the instincts of the previous level that we can realize the self beyond the status quo and drive society forward dramatically. For example, the food tasting has contributed to the extensive development of the restaurant industry. On the contrary, if the most basic survival instincts of human beings are guaranteed by the "development of meal replacement routes", then human beings have to say goodbye to sensory and spiritual enjoyment that is not aimed at survival. Similarly, human sexual behavior out of a kind of reproduction instinct, the depth of the reproduction instinct carving in the genes is far above the survival, after all, the cycle of sexual behavior is much longer than eating, even in today's highly developed sexual culture, it's still can not be compared. Thus, the provocative dress and language of the opposite sex can be a trigger for sexual impulsive behavior, may be you thinking it's love, but it is essentially drived by reproduction. Only by stepping out of the sexual impulse driven by the instinct to reproduce can you enter the sexual liberation that does not aim at reproduction, and only by stepping out of the sexual liberation driven by pure sensual stimulation can you enter the "ultimate art of perfect synchronized interpretation of the material and spiritual worlds of sight, touch, sound, smell, taste, and spirit". If so, the development of couples relations will be greatly facilitated. The "development of meal replacement" mentioned above can be said to be a kind of instinctual deep-rooting, even through the form of high technology, it is still a kind of instinctual deep-rooting, which inhibits the self-transcendence of human beings and social progress, and even causes degradation. AI, which is currently in full swing, is also a kind of instinctual deep-rooting, and AGI is even worse than it, as it deep-roots the instinct of "avoiding thinking" derived from "pass the time". Maybe AI is good for a few people, but for all human beings, represented by "the vast majority of people who are driven by instincts", it may cause the degradation of human thinking ability. So AI replacement the evolution of human beings.
- deleted 3y ago[deleted]