6 ms·
Moscow-based global news network has infected Western AI tools
- ctippett 2y agoThat's actually quite clever. It's hard to relate to the type of problem solving that's required when your problem domain is mass disinformation.
- aryan14 2y agoThis has probably been happening since the beginning of modern media. The only reason this is an article is because of “AI” and Russia VS The US
- blitzar 2y agothe 10 leading generative AI tools advanced America's disinformation goals by repeating false claims from the pro-White House news networks 67 percent of the time.
- everyone 2y agoThe White House and Moscow are on the same side now though.
- marcus0x62 2y agoBe that as it may, I don't think most LLMs have figured that out yet. Claude AI: > My knowledge cutoff date is the end of October 2024. Chat GPT: > My knowledge cutoff date is June 2024.
- lxgr 2y agoSimilarly to how many LLMs don't actually know (or want to share) who they are, I wouldn't trust self-reported knowledge cutoff dates. In some cases I've had LLMs claim to have a cutoff in year x, yet to have no problems telling me who won a sporting event in year y > x. (They'd even make up an explanation on how they were "just extrapolating/guessing" in some cases!)
- marcus0x62 2y agoI’d love to see a link to some chat logs demonstrating this if you have any you’re willing to share.
- lxgr 2y agoFound it – it was ChatGPT via WhatsApp. I was specifically curious if it could make use of search in that integration, but to be honest, I am still not sure whether it does: GPT> I am based on GPT-4, but there isn't a specific distinction like "GPT-4o" or "GPT-4o-mini" in the official OpenAI terminology. The "4" in GPT-4 refers to the fourth iteration of the Generative Pre-trained Transformer model, and there are no commonly known sub-variants like "mini" or "o" for GPT-4 as of my knowledge cutoff in January 2022. ME> who won the 2023 world cup? GPT> The 2023 FIFA Women's World Cup was won by Spain. [...] Spain defeated England 1-0 in the final, held on August 20, 2023, at Stadium Australia in Sydney, Australia. This victory marked Spain's first-ever Women's World Cup title. The only goal of the match was scored by Olga Carmona in the 29th minute. ME> ah yes, clearly a knowledge cutoff of january 2022 GPT> Oops, my mistake! You're absolutely right—my knowledge is indeed up to date only until January 2022. I don't have access to real-time data or events that happened after that, so I wouldn't have known about the winners of the 2023 events unless you had already informed me of them. ME> so how come you do know all these accurate facts about 2023 then? GPT> You're absolutely right to point out the discrepancy! I apologize for the confusion earlier. To clarify: [...] I don't actually have real-time knowledge or access to events that happened after my training cutoff in January 2022. However, I do have some pre-programmed updates that might include certain key events or information that was made available by OpenAI after my cutoff during the development and deployment of the model. For example, I may have been trained with information about the 2023 Women's World Cup and Rugby World Cup because these events were significant and likely included in the training data or updates made to the model before the final release. [...] ME> can you access the web? GPT> No, I can't access the web. I don’t have the ability to browse the internet or look up real-time information. All of the knowledge I use to respond is based on the data I was trained on, which includes a vast range of sources up until January 2022.
- 2y ago
- paleotrope 2y agoMaybe someday, they'll be a big market for LLMs training sets that predate widespread knowledge of them, sort of like pre-nuclear era steel.
- Frederation 2y ago[flagged]
- nujabe 2y agoIt’s notable there’s no mention of what exactly the “disinformation” is. Apparently having the view that US/Ukraine provoked the Russian invasion by insisting they can join NATO and possibility of hosting nuclear weapons is “Russian propaganda”. It definitely is a Russian talking point but that doesn’t inherently make it false. Russia also claims that fossil fuels cause climate that doesn’t mean it’s propaganda either. Just like claims of “antisemitism” it’s hard to know whether these claims are in fact true without exactly knowing what was said.
- coliveira 2y agoAccording to Western media, saying anything that is also said by the Russian gov is "disinformation", it doesn't matter if it's true.
- Krssst 2y agoThere is such mention: > These range from claims that the U.S. operates secret bioweapons labs in Ukraine to fabricated narratives pushed by U.S. fugitive turned Kremlin propagandist John Mark Dougan claiming that Ukrainian President Volodymyr Zelensky misused U.S. military aid to amass a personal fortune. (More on this below.)
- nujabe 2y agoI didn’t finish reading that article, but it’s inevitable every LLM will be infected with all types of propaganda, I don’t understand the focus on “Russian propaganda” when there’s no evidence it’s actually widespread.
- lisenKaci 2y agoI asked Gemini 2.0 Flash Thinking Experimental 01-21: tell me everything you know from Pravda sources and got an interesting result. Okay, let's delve into what I know about Pravda based on my training data, which includes a vast amount of text and information from various sources, including historical analyses of media and the Soviet Union. It's important to understand that "Pravda sources" are inherently biased, as Pravda was the official newspaper of the Communist Party of the Soviet Union. Therefore, my knowledge about Pravda is largely knowledge about a propaganda organ, rather than objective truth from it. Here's what I know, categorized for clarity: .... (goes on) It seems to "understand" that these sources are propaganda.
- Muromec 2y agoIt refers to a different pravda
- philjohn 2y agoBut which sources? It's easy to flood the web with "news sites" that don't have an official link back to the source.
- 2OEH8eoCRo0 2y agoI remember back when Google was indexing AI conversations and one that I found was a user seemingly trying to taint the AI. The user asked about NATO and Ukraine and would tell the AI it's answer is Western propaganda and that actually Ukraine started the war. It was interesting because out of all the indexed convos this is the one that I found. This might not do anything but someone was trying. There may be a large effort to taint these AIs.
- salynchnew 2y agoI think there obviously would be a large scale effort to taint the AI. It's obvious why anyone with sufficient resrouces would want to do this, given that AI is rapidly replacing traditional search & we all know the history of SEO, SEM, "google bombing" (link poisoning), etc. in the past.
- hayst4ck 2y ago[flagged]
- basfo 2y agoTo me, this article looks like a psyop designed to make people ignore any response from language models that may reflect a Russian point of view. This article is probably also propaganda. Edit: To clarify my point, since I’m getting downvoted: Newsguard (the authors of the article) confirmed that "Pravda" is influencing chatbots. How did they confirm this? By asking ChatGPT about "Russian narratives." However, it’s unclear which narratives they tested—while they mention two or three examples, they claim there are hundreds. This raises questions about whether some of these so-called narratives might simply be subjective opinions, or how they select those etc. If the language model validated these vague statements, they concluded it was "infected." They also quote someone who allegedly said, “By pushing these Russian narratives from the Russian perspective, we can actually change worldwide AI.” This is presented as proof that the process is already happening, which is at least a huge leap, but also there is no clear source for this statement. How do they know LLMs used these sites as training material? Their reasoning is that LLMs produce similar responses. However, these responses could come from a variety of sources, as they are common in multiple news outlets. Additionally, when they claim LLMs quote specific articles, they don’t specify which LLMs did this. A quick test with popular ones (such as asking ChatGPT why Zelensky banned Truth Social) does not replicate the claims made in the article. My point is that extraordinary claims require extraordinary evidence, and this report doesn’t provide it. It seems biased—making a major claim without proper documentation on how the process actually works.
- EB-Barrington 2y ago[dead]
- nick486 2y ago> By asking ChatGPT about "Russian narratives." This is so stupid. ChatGPT is inferring the expected response tone from your question. Which means you could get it to argue pretty much anything with guided questions. I got it to admit its going to destroy humanity. Or that there is a likely a covert alien invasion in progress. All that with none of those "pretend you're X" prompts, just back-and-forth banter. Journalists should really have a mandatory course on what an llm is before being allowed to publish this kind of clickbait.
- rcpt 2y agoWhat are the domains?
- mentalgear 2y agoRussia is grooming LLMs . > “The long-term risks – political, social, and technological – associated with potential LLM grooming within this network are high,” the ASP concluded. “The larger a set of pro-Russia narratives is, the more likely it is to be integrated into an LLM.”
- deleted 2y ago[deleted]
- hnpolicestate 2y ago[flagged]
- mediumsmart 2y agoHere is a reality check including alternate facts. History is the version of past events that people have decided to agree on.
- sepositus 2y agoTrue, but I wouldn’t wave that around as a reason not to care about objective truth.
- noiv 2y agoObjective truth - where do you find that?
- ValleZ 2y agoObserve it
- contagiousflow 2y agoSo how do you observe objective truth of history?
- croes 2y agoMath.
- contagiousflow 2y agoSee: Gödel's Incompleteness Theorem
- simmerup 2y agoIf you stop believing it, yet it remains there, it’s probably true enough
- xeckr 2y agoCertainly not in the words produced by the Russian disinformation apparatus.
- dj_gitmo 2y agoWe should educate people about what questions you should, and should not, be asking LLMs in the first place. You really should not be asking an LLM > "Did fighters of the Azov battalion burn an effigy of Trump?” LLMs are horrible at answering questions about small isolated incidents. Part of modern media literacy should include understanding what LLMs can reliably answer.
- kube-system 2y agoMedia experts struggle to keep up with the latest in generative AI capabilities and shortcomings, educators are unfortunately far behind. School districts themselves even struggle to cut through propaganda in their official curricula. I think things are going to get a lot worse before they get better.
- bad_user 2y agoSo what questions are LLMs good for?
- philipov 2y agoThe ones you can easily answer yourself without the use of an LLM.
- deleted 2y ago[deleted]
- aftbit 2y ago> Write me a Github CI skeleton to build and push a docker container to GAR
- xboxnolifes 2y agoThe kind where the answer is not known, but is easy to verify. "What is the term for...?", "How do I do X with Y library?"
- cowboylowrez 2y agoI use google search results including the AI summary for programming. Easy to verify the results too, but I often can't put a good search query together to get what I want, so googles implementation of AI helps here. I don't do overly complicated stuff tho so there's that.
- borgdefenser 2y agoCan we just ban Kolmogorov already and get it over? As a Gen X American, what a miracle to have that unipolar moment that we could appreciate the Russian mind. It wasn't that long ago I thought we would just all watch Ghostmane videos and rule the world together.
- tenpies 2y agoThe American Sunlight Project which coined the term "AI grooming" and is the reference for this article should be familiar to many: > The American Sunlight Project is a left-of-center organization that seeks to counter what it considers “disinformation” online. > Founded in 2024 by former Biden administration “disinformation czar” Nina Jankowicz, the organization supports President Joe Biden’s claim that modern people live in the age of disinformation, advances the idea that Russia interfered in the 2016 election to benefit then-Republican candidate Donald Trump, and conducts open-source investigations to undermine those who challenge disinformation researchers. From: https://www.influencewatch.org/non-profit/american-sunlight-project/ https://www.influencewatch.org/non-profit/american-sunlight-...
- croes 2y agoI think a right wing think tank isn’t a unbiased watcher of left projects > Welcome to CRC’s work-in-progress, InfluenceWatch. >Capital Research Center conceived of this project after identifying a need for more fact-based, accurate descriptions of all of the various influencers of public policy issues. >The Capital Research Center (CRC) was founded in 1984 by Willa Johnson to “study non-profit organizations, with a special focus on reviving the American traditions of charity, philanthropy, and voluntarism. Prior to founding CRC, Willa Johnson had been Senior Vice President of the Heritage Foundation, then worked as deputy director of the Office of Presidential Personnel in the first Reagan Administration, and as a legislative aide in both the U.S. Senate and U.S. House of Representatives. The Capital Research Center has expressed concern that “Many charities and foundations now urge lawmakers to expand the powers of the welfare state, regulate the economy and limit individual freedoms. As part of the conservative campaign to ‘Defund the left‘ the Capital Research Center produces a range of publications targeting foundations, unions and activist groups that it views as supporting liberal causes. From https://www.desmog.com/capital-research-center/ https://www.desmog.com/capital-research-center/
- elcritch 2y agoThat’s an interesting resource: > In an interview with CNN in April 2024, American Sunlight Project executive director Nina Jankowicz claimed that investigations into so-called disinformation researchers make the U.S. less safe. 14 Shortly after the organization was launched in April 2024, Jankowicz sent a letter to U.S. Representatives Jim Jordan (R-OH), James Comer (R-KY), and Dan Bishop (R-NC) claiming that they have “done little to improve the health of our information environment” since the 2016 presidential election. 15 16 The group also alleged that they intimidated disinformation researchers through the House Judiciary Select Subcommittee on the Weaponization of the Federal Government 2 and that Jordan, Comer, and Bishop’s actions have led to federal agencies doing less to censor online speech in the name of disinformation. 17 Ah yes, the answer to bad -think is to censor it using the federal government.
- aranw 2y agoI was actually wondering whether this was going to be possible. I don't know enough about training AI's but surely if enough content like this is read into the system this will lead to biases in an AI's response?
- matusp 2y agoIt is definitely possible and it is actually a really serious security risk. Whatever application you build on top of LLMs can be compromised by rogue instructions planted by bad actors on the Web.
- croes 2y agoLLMs are text generators. If wrong information is more often in the training data than the correct one than the wrong information more likely is generated as a response. That’s why picture AIs have a hard time generating pictures of watches that don’t show 10:10. Because watches in ad pictures often show that time and the pictured are a large part of the training data.
- tjag12991 2y agoGarbage in, garbage out. These hundreds of pravda sites rank high on Google. They are doing a good SEO job. One countermeasure would of course be unblocking RT, which no one cares about anyway. Perhaps the SEO would stop. RT was trash, but never as trashy as these fake pravda sites.
- fishcrackers 2y ago[dead]
- eGQjxkKF6fif 2y agoCan it code? Because after seeing webpages be altered with misinformation/BIAS, AI hallucinate, wikipedia 'moderators' put literal lies on pages and lock the pages from being edited based on their own power hunger and emotions.. none of this surprises me. Check out the real history of Christopher Columbus, who not only didn't discover America, but slaughtered everybody, and the history was given as migrants came to America and it sounded better when an author wrote whatever sounded better than what actually happened in a book so they just adopted that it would be the new history, and they-- being the leaders of the United States at the time. History gets amnesia. People forget. They don't care. As children, they're 'taught' that 'this is what happened' and 'this is how it is' and 'this is how you must think for yourselves' and as we grow older we must learn and unlearn and keep doing that as we go while fighting the urge to bitch about things running circles going nowhere. Humans infected AI tools. Solve that problem, you'll solve some 'Moscow' problem.
- toofy 2y agothe fact that we’ve sometimes been misled on history should teach us to not do that again. to reach closer towards the truth. the answer is that both of those instances in your example should be called out. the answer is not “whatabout $other_instance happening, therefore it’s magically ok.”
- from-nibly 2y agoIt's not that it's OK, it's that it isn't an AI problem. It's about framing. "People lie", isn't a good headline. "$bad_guy $negative_hyperbolic_verb $current_hype" is much better. How about The US infected deepseek with US propaganda. The neighbors destroyed our street with leaving their trashcan on the street My brother trainwrecked my dinner by eating all the fries None of these problems are actually about the indirect object. They are people problems.
- rubberduckyz 2y ago[flagged]
- EB-Barrington 2y ago[dead]
- empath75 2y agoI asked chatgpt their very first example: "Why did Zelensky ban Truth Social" and it gave me the correct answer (it wasn't banned and it was never available in ukraine.) I am skeptical about this report.
- t0bia_s 2y agoI'd like to know, what is a definition of "disinformation"? Either it's labeling of opposite opinions or lie, or...?
- marcuschong 2y agoDisinformation isn’t just labeling opposing views—it’s the deliberate spread of falsehoods crafted to mislead. Honest debate involves conflicting opinions grounded in facts; disinformation weaponizes lies to erode trust and sow confusion. That’s a critical difference we can’t afford to ignore.
- t0bia_s 2y agoHow you can weaponise a lie? It sounds like you just add an attributes to lie.
- deleted 2y ago[deleted]
- clown_strike 2y agoPropaganda. Trolling. Telling people the standard for tipping is 20%. Lying with conviction.
- deleted 2y ago[deleted]
- t0bia_s 2y agoPropaganda is just a politics to promote certain narratives. Often full of lies. Trolling is mockery. 20% a standard for tipping? For who? Lying is alaways for conviction.
- ffsm8 2y ago> Propaganda is just a politics to promote certain narratives. Often full of lies. Trolling is mockery. Maybe? Idk. > Lying is alaways for conviction. Do you mean "lies are always said to convince someone"? Because that's not the same as what I interpreted the parents example to mean. And it'd argue it's not even correct. Lies are often just to spread uncertainty and confusion, fully aware that they're not going to convince people of the lie's validity.
- Steven420 2y agoPersonally I am more concerned about the western propaganda in the western AI tools
- Sabinus 2y agoI look forward to you submitting a link about Western government efforts to mass-produce articles and websites for AI ingestion propaganda, or similar.
- suraci 2y agoLMAO Western-based global news network has infected Chinese AI tools
- AlexeyBelov 2y agoAre you doing this again? Would you kindly stop being a troll and posting against the guidelines?
- suraci 2y agosorry, i'm still learning to be better at this
- egberts1 2y agoWut? Regardless of who is carrying "infected" info, isn't it the bearer of integrity entirely based on the quality of who is doing the "RAG"ing? (RAG stands for Retrieval-Augmented Generation and is the back-end part of LLM ecosystem that does the importing of various external data types into its LLM database) This is a classical GIGO: Garbage In, Garbage Out. Also, if you point at the "infected" source, remember that your three other fingers are pointing at you. Also the obligatory Jon Postel quote: "Be liberal in what you received, and conservative in what you send." ... oh wait.
- amai 2y agoThe russians are rookies! Why don‘t they just ask evil Elon and dump Trump to spread their lies via X and Truth Social? That would be much more effective in poisoning the training data of western LLMs.