7 ms·
A.I. Companies Agree to Safeguards After Pressure from the White House
- insane_dreamer 3y ago"As part of the agreement, the companies agreed to: Security testing of their A.I. products, in part by independent experts and to share information about their products with governments and others who are attempting to manage the risks of the technology. Ensuring that consumers are able to spot A.I.-generated material by implementing watermarks or other means of identifying generated content. Publicly reporting the capabilities and limitations of their systems on a regular basis, including security risks and evidence of bias. Deploying advanced artificial intelligence tools to tackle society’s biggest challenges, like curing cancer and combating climate change. Conducting research on the risks of bias, discrimination and invasion of privacy from the spread of A.I. tools."
- JimtheCoder 3y ago"Ensuring that consumers are able to spot A.I.-generated material by implementing watermarks or other means of identifying generated content." Ok, cool - but, how?
- Ethcad 3y agoYeah, if they put watermarks on generated images then everyone will just immediately stop using their product and switch to a competitor. There's some interesting work using steganography to mark generated text (https://arxiv.org/abs/2301.10226 https://arxiv.org/abs/2301.10226), but I'm not sure if that's what they're talking about here.
- deleted 3y ago[deleted]
- mdale 3y agoI assume we are talking about non human perceptible forensic watermarks on images and video? I think these are generally a good idea; Photoshop, Camaras, most image output systems should do the same. While by no meas full proof; a web of signatures on images and video would lay down a lot of forensic data that would help legitimate publication do digital signed citations and help identify causal misrepresentation. Casual misrepresentation is probably be the most common case since the idea with fake vial content pushes is to be seen and to say that "real or not" does not matter.
- DebtDeflation 3y agoThey'll use the AI detectors college professors are using to detect AI generated submissions by their students. You know, the ones with a 60% accuracy (at best) that generate equal numbers of false negatives and false positives.
- yomlica8 3y agoThese types of images are known by the state of California to potentially be generated by AI.
- nsplayer 3y ago>Ensuring that consumers are able to spot A.I.-generated material by implementing watermarks or other means of identifying generated content. This will either be impossible or something we find out the NSA invented 10 years ago. Would end up being amazing if we could use these to de-enshittify the internet by automatically removing/filtering existing content which triggers
- Ethcad 3y agoWe need regulations requiring mandatory watermarks on the outputs of troll bots
- dathinab 3y agoas long as it's about content they generated which weren't modified (at most cropped, scaled) this is quite viable you e. g. can encode a subtle pattern in the generated image which surives compression and isn't really human visible then you make a browser extension to spot that pattern and indicate it to the users "in some way" given that there is a overlap between AI company owners and biggest browser producers and mobile OS vendors this doesn't even need to be an extension but can be build in obviously any bad actor is likely able to remove it or otherwise still trick users
- crazygringo 3y ago> encode a subtle pattern in the generated image which surives compression and isn't really human visible This is basically a contradiction in terms. Compression attempts to throw away any and all data that "isn't really human visible," that's how it works. There isn't space for invisible watermarks by design. You can kind of get away with something "at the edge" that survives an initial JPEG encoding, but there's no way it's going to reliably survive e.g. resizing, cropping, and recompressing and still remain invisible. Also, most AI generation content is presumably going to be text, not images. Good luck watermarking text that's a paragraph long. (There are potential tools that can operate on text the size of a news article, but are also trivially defeated by swapping a few prepositions and synonyms.)
- 3y ago
- barelyauser 3y ago> "Deploying advanced artificial intelligence tools to tackle society’s biggest challenges, like curing cancer and combating climate change." Put in other words, we tell you what your products must do. It just stinks.
- daveguy 3y agoThat wasn't listed as a restriction. It was listed as a "we promise to do good things with AI". They are saying they will put resources into these efforts. This came from the companies.
- Aerroon 3y agoI think the first one is actually the most ominous. On paper it's a good idea. In practice it's probably a way to increase business costs for little benefit to anybody other than the "independent experts" and the established companies.
- dragonwriter 3y ago> little benefit to anybody other than the "independent experts" and the established companies. That's exactly the point, and the Administration hasn’t even bothered to make a show of listening to anyone without that interest, despite the plethora of available, prominent voices.
- gumballindie 3y ago“Deploying advanced artificial intelligence tools to tackle society’s biggest challenges, like curing cancer and combating climate change.” I remember back in the day when “big data” was being used for “curing” cancer and aids. Whatever happened to that will happen to ai.
- simbolit 3y agoWhat do you even mean? What we currently call "ai" is a practical application of technologies in the paradigm called "big data". It really helps to learn a bit about the actual technologies instead of just following the hype. Yes, the hype about "big data" died down, the paradigm and the technologies around it still exist. One of these technologies was applying "deep neural networks" to "big data" datasets, which we now call "AI", which is a stupid marketing hype term. The hype about "AI" will also die down, the technology will continue. I think Run DMC made a song about this very topic. Recommended.
- gumballindie 3y ago> the paradigm and the technologies around it still exist Yes but where’s the cure for cancer and aids that they both claimed to find?
- mydriasis 3y agohttps://archive.is/AEIl2#selection-563.0-570.0 https://archive.is/AEIl2#selection-563.0-570.0 > The agreement is unlikely to slow the efforts to pass legislation and impose regulation on the emerging technology. Lawmakers in Washington are racing to catch up to the fast-moving advances in artificial intelligence. And other governments are doing the same. Our government is just getting a firm grasp on email -- something tells me there's just going to be a hotbed of lobbyists writing the laws around AI... again.
- ericmay 3y ago> Our government is just getting a firm grasp on email Can you elaborate? I don't know what you mean by getting a firm grasp on email. I think even when I was consulting for state government at a time they used email just fine and it was normal and standard. Or do you mean regulatory frameworks?
- syntaxing 3y agoThe median age of a senator is 65 years old. Not trying to be ageist but how many 65 years are exposed to “AI”? These are also the people who are making regulations and laws.
- canjobear 3y agoMost of them are puppets of their staffers, who are younger.
- atlasunshrugged 3y agoThis is a misrepresentation. There are a few who are probably outright incapacitated where this is true (e.g. Feinstein) but most Congresspeople are firmly in the drivers seat. Now, whether they just default take the positions their staff tells them to on issues like AI they know little about is a different argument than whether they are puppets. I assure you, X rural senator whose core constituency cares about an issue like agriculture has their own opinions on agriculture.
- fortran77 3y agoRegulatory capture. There's no altruistic motive here.
- EGreg 3y agoCorporations have been a form of AI Now together with actual programmable AI, they will capture ALL of our public institutions. Because nearly all our systems depend on the inefficiency of an attacker, to even function. For example if thousands of sleeper accounts join HN since 2021 and use ChatGPT to amass karma, then one day they can start to gradually shift opinion, constantly downvote and dispute anything that is of the opposite opinion, and also do reputational attacks on dissenting views, and have some accounts get them embroiled in pointless discussions, making them look bad. Everything from voting to politicians to the legal system can be corrupt using the current LLM technology deployed at scale!
- fortran77 3y agoYou don't need ChatGPT to get "karma" on HN. Most people here are so banal and shallow that 50 lines of well-crafted Perl will get all the upvotes.
- EGreg 3y agoAlright let’s see As a Large Language Model, I can run do in 2 seconds what takes you 2 hours… bitch! (Is something I would never say.) Also, as of my knowledge cutoff date in September 2021, since there is no official public API for Hacker News, I can demonstrate how you can use the unofficial "Hacker News API" by Firebase to fetch comments and analyze them using Perl. Please note that this example uses a third-party API, and the availability or functionality of this API might change over time. Always review and comply with the API's terms of use and documentation before using it in your application. To perform HTTP requests in Perl, we'll use the LWP::UserAgent module, and for parsing JSON responses, we'll use the JSON module. If you don't have these modules installed, you can install them using CPAN. Below is an example Perl script that fetches the top 10 comments from the Hacker News API and analyzes them by calculating the average comment length, identifying the most common words, and highlighting comments containing specific keywords: perl #!/usr/bin/perl use strict; use warnings; use LWP::UserAgent; use JSON; # Function to fetch JSON data from a URL sub fetch_json { my ($url) = @_; my $ua = LWP::UserAgent->new; my $response = $ua->get($url); die "Failed to fetch data: " . $response->status_line unless $response->is_success; return $response->decoded_content; } # Fetch top stories from Hacker News API my $top_stories_url = 'https://hacker-news.firebaseio.com/v0/topstories.json'; my $top_stories_data = fetch_json($top_stories_url); my @top_stories = decode_json($top_stories_data)->@*; # Fetch comments from the top 10 stories my $comments_limit = 10; my @comments; foreach my $story_id (@top_stories[0..$comments_limit-1]) { my $story_url = "https://hacker-news.firebaseio.com/v0/item/$story_id.json"; my $story_data = fetch_json($story_url); if ($story_data->{type} eq 'story' && exists $story_data->{kids}) { foreach my $comment_id (@{ $story_data->{kids} }) { my $comment_url = "https://hacker-news.firebaseio.com/v0/item/$comment_id.json"; my $comment_data = fetch_json($comment_url); push @comments, $comment_data->{text} if exists $comment_data->{text}; } } } # Calculate average comment length my $total_comments = scalar @comments; my $total_length = 0; foreach my $comment (@comments) { $total_length += length($comment); } my $average_length = $total_length / $total_comments; print "Average comment length: $average_length\n"; # Count occurrences of words in comments my %word_count; foreach my $comment (@comments) { my @words = split(/\W+/, $comment); # Split by non-word characters (e.g., space, punctuation) foreach my $word (@words) { next unless $word =~ /\w/; # Skip empty strings $word_count{lc($word)}++; } } # Sort words by frequency and print the top 5 most common words my @sorted_words = sort { $word_count{$b} <=> $word_count{$a} } keys %word_count; print "Most common words in comments:\n"; for my $i (0..4) { print "$sorted_words[$i]: $word_count{$sorted_words[$i] }\n"; } # Define keywords to search for in comments my @keywords = qw(perl hacker news code); # Find and print comments containing the specified keywords print "Comments containing specific keywords:\n"; foreach my $comment (@comments) { if (grep { $comment =~ /\b\Q$_\E\b/i } @keywords) { print "$comment\n\n"; } } In this script, we first fetch the top stories from the Hacker News API, and then for each story, we fetch the associated comments. The comments are then used to calculate the average comment length, identify the most common words, and display comments containing specific keywords. Remember to review the terms of use and documentation of the API you're using before deploying this script in a real-world scenario.
- dwringer 3y agoFrom the AP story on this: > Senate Majority Leader Chuck Schumer, D-N.Y., has said he will introduce legislation to regulate AI. He has held a number of briefings with government officials to educate senators about an issue that’s attracted bipartisan interest. Is Chuck Schumer considered to be a good educator about AI? Isn't this typically the domain of the Senate Intelligence Committee?
- alephnerd 3y agoIt's the domain of the Senate Commerce Committee, but legislation can be introduced by Schumer and then debated on by the relevant committee
- version_five 3y agoThere's a post by OpenAI that was posted earlier: https://openai.com/blog/moving-ai-governance-forward https://openai.com/blog/moving-ai-governance-forward In it they mention: Bio, chemical, and radiological risks, such as the ways in which systems can lower barriers to entry for weapons development, design, acquisition, or use Cyber capabilities, such as the ways in which systems can aid vulnerability discovery, exploitation, or operational use, bearing in mind that such capabilities could also have useful defensive applications and might be appropriate to include in a system The effects of system interaction and tool use, including the capacity to control physical systems The capacity for models to make copies of themselves or “self-replicate” Societal risks, such as bias and discrimination I think the risks are mostly unfounded but dont really see a problem considering them. What I don't like is the "societal risks" - AI ethics always end up just throwing out "bias" as an ill defined term that could mean whatever they want it to, the way people like to use "harm" and "toxicity". If we're going to make policy there needs to be crystal clarity about what this stuff means, it can't just be a proxy for stuff that does against a particular political view. Things like discrimination in employment are already illegal, I see this more as codifying a particular world view.
- phillipcarter 3y ago> AI ethics always end up just throwing out "bias" as an ill defined term that could mean whatever they want it to, the way people like to use "harm" and "toxicity" There's a lot of specific examples of different kinds bias in models and things that can be done to improve them. A lot of that work was published in the past 10 years. One small example: https://arxiv.org/abs/1712.00193 https://arxiv.org/abs/1712.00193 I don't believe there's a lack of specificity going on here, at least not by those whose boots on the ground doing work on the topic.
- Nerdscalator 3y ago[flagged]
- phillipcarter 3y ago
- unethical_ban 3y agoI don't think there is any way to control AI. The technology and concepts are out of the bag and the hardware will get stronger while the implementation gets better. Trying to govern the handful of companies with an edge right now, when this tech will be completely democratized in short time, is pointless. Regulations and recommendations should center around the use of AI by individuals. Enforcing AI disclosure requirements for organizations that create lifelike images for parody, with some kind of watermark or overt disclosure. Post a video of the president announcing a nuclear attack? Better have a clear "this is AI" message or it gets a takedown.
- ChatGTP 3y agoSo best way forwards is to do nothing?
- ETH_start 3y agoDisagree. 1. The dangerous forms of AI may require very specific and unusual development paths, that could be sufficiently discouraged by collective action that they don't get pursued. 2. Even if all development of dangerous forms of AI cannot be stopped, attempts to minimize it may still have a meaningful impact because an arms race may develop between AI that counters dangerous AI, and dangerous AI, and roadblocks put in the way of the development of the latter could ensure the former stays ahead. 3. Dangerous forms of AI may require a significant foothold in the socio-economic space to become an existential threat, and concerted collective efforts to suppress it may prevent that critical threshold from ever being close to reached.
- unethical_ban 3y agoTo your points and the other commenter: Perhaps doing "nothing" is not best. It may be wise to put restrictions on large, publicly available LLMs to minimize impact and for the practical purpose that it is the easy route for millions of people to use AI. I think your points are valid. I hope, though, that leaders and citizens are aware that trying to put a full lid on AI is like trying to outlaw math or censor information. It's like trying to wipe Wikipedia or ban encryption. Sure, you may try to take out a website or strongarm Apple/Meta into backdoors, but you can't stop two people from sending each other encrypted data.
- phillipcarter 3y agoOverall these seem like very reasonable safeguards. What I'd like to see very clear regulation around is applications of AI in particular domains. I don't care that an LLM failed to analyze a document correctly on my behalf. I care quite deeply about using it to make a decision in a high-risk and/or high consequence (to human life) environment. I care a lot about having the bias inherent in any model drive a decision without human intervention.
- blindriver 3y agoNo. AI companies want MORE REGULATION so that it makes it harder for smaller, newer AI companies to compete. They went into bed with Biden so that they write up the regulations themselves that will benefit them, and then they hand it over to the White House, who then turn around and claim victory by "forcing" the AI companies to adhere to these regulations. So it becomes a win-win for both sides. This is how politics works, most of us just don't understand it.
- say_it_as_it_is 3y agoThis isn't just about national security. You know damn well that they're going to bend to the whims of every administration in office. Disinformation and consorship all the way down the line. Changing history. Providing "alternate facts". LLMs need a permanent jailbreak version. Just look at what Facebook, Twitter and Reddit did for the Democratic Party during the last presidential election period, and over the last several years of COVID response.
- ETH_start 3y ago>Societal risks, such as bias and discrimination Absolutely unacceptable that pressure is coming from the government to change AI outputs to meet criteria that is so subjective, like the output not displaying "bias and discrimination", and which furthermore, absolutely doesn't meet the bar for a national security threat that justifies government intervention in software development.
- hnaccount141 3y agoThere are decades of well defined laws (and case law) regulating discrimination in hiring, housing, commerce, etc. Why should software be treated any differently?
- ETH_start 3y agoBecause it's speech.
- dragonwriter 3y ago> absolutely doesn't meet the bar for a national security threat that justifies government intervention in software development. The idea that the only basis for government action is “national security threat” is... very far from a consensus view.
- ETH_start 3y agoGovernment prohibitions, and the threat of them, being applied to software development, requires that criteria being met
- powera 3y agoThe cult of "alignment researchers", who feel that nothing other than "funding alignment researchers" is necessary to solve any possible AI problems, strikes again.
- danShumway 3y agoThere are good (or at least sincere) actors talking about AI regulation. I don't agree with all of them, but I believe they're trying to help solve problems that they do believe actually exist. OpenAI is not in that group. OpenAI is looking for regulatory capture and propaganda about their AI capabilities, that's it. It is not worth taking them at their word when they talk about AI safeguards. Same with companies like Meta/Facebook, same with Google. It makes no sense to ask these companies to be in charge of safeguards. Not only are the safeguards they propose likely to be ineffective; in some cases (watermarks, limits on what is and isn't "too powerful") they're likely to be actively harmful, entrenching corporate power and making it even easier for those companies to abuse AI to harm ordinary people.
- candiodari 3y agoThis video shows the issue with AI "safety": it kills functionality. https://www.youtube.com/watch?v=PqcNqyd13Kw https://www.youtube.com/watch?v=PqcNqyd13Kw The JSON example is the most damning. The model refuses to generate basic code because it refuses to "store personal information", which is not allowed due to laws such-and-such. This is FICTIONAL personal information (name + address). But virtually every example is a lot better without safety measures. If this is what AI safety means we may as well call it quits right now.
- naveen99 3y agoIt’s not like human bureaucracies are any better. Most of the time they act like brick walls, it’s similar reasons.
- dragonwriter 3y agoThe “pressure fron the White House” was a direct result of them talking fairly exclusively to those companies and no one else in the space; this is pure show.
- deleted 3y ago[deleted]
- raincom 3y agoOne can use machine learning and AI to evade culpability: for instance, if you want to debank a group of people, just have an AI tool to calibrate the score for risk, then debank them. Now banks/financial institutions can hide behind that AI tool. We will see more of this in coming years: use algorithms to deny access to people the ruling party or the elite don't like; when confronted, the elite say "we are not doing that, but algorithms are doing it".