6 ms·
When A.I.'s Output Is a Threat to A.I. Itself
- nyc111 2y agohttps://archive.is/kbb9A https://archive.is/kbb9A
- beachy 2y agoThis may work better (gift article): https://www.nytimes.com/interactive/2024/08/26/upshot/ai-synthetic-data.html?unlocked_article_code=1.F04.kJ4l.YL3ADZ0eRmy4 https://www.nytimes.com/interactive/2024/08/26/upshot/ai-syn...
- akira2501 2y agoThis is a nice gesture, but true to my form, I'm going to spring board off of it with negativity: This is the absolute stupidity of pay walls in order to force a small segment of users into third party dynamic ad insertion. It's greedy and lazy while somewhat giving away editorial control of articles to whatever javascript gets shoved down the pipe at you. That newspapers haven't build their own ad serving network or their own analytics network in 2024 is something I seriously didn't expect. It's so mind boggling, I refuse to even take their freebies at this point, I'd much rather get the article through a third party that strips everything out. It sends the correct message, you're greedy, and now you get _nothing_.
- beachy 2y agoI don't quite follow your thought process but admire your vociferousness. In this case I got this link from a newsletter, who presumably have a deal with NYT in that from time to time they are able to offer a special "back door" through the NYT paywall. NYT expects this will increase their paid audience, and the newsletter gets valuable content to increase their own value to their readers so a win-win for them both. This particular article doesn't render properly through the parent archival site's link, but it does though the link I provided. Wishing you luck in your crusade against paywalls! Personally I find them annoying but don't see how I can legitimately have an issue with them, it seems like simple capitalism at work.
- AceyMan 2y agoSo, you don't think quality journalism is worth paying for, upfront, direct to the creators, but rather through a proxy system based around advertising Correct me if I'm wrong about that <shrug>.
- brudgers 2y agoBecause GOGI is cheaper than Mechanical Turk. +-------------+ | | | | +--->LLM----->+
- technoccultist 2y agoAn inhuman centipede
- akira2501 2y agoEven then they were hiring from the bottom of the barrel of Turk's. I have significant doubts about the quality of any of the data.
- daliusd 2y agoWhat is GOGI?
- ggm 2y agoEither Daniel Dennett or one of his friends wrote a thought experiment story about the worldwide brain science drive where every participating scientist gets one neuron from the disected brain to keep alive in a tank, observing its firing patterns. One day one of them notices his neuron has died, so he quietly wires the input to the output through a circuit which fires the same way.. (I think this is in "the minds I" (1981)
- romwell 2y agoTomorrow's LLM-based doctor: You've got a fever, and the only prescription is MORE COWBELL Can't wait to see what fixed points will emerge in this dynamical enshittification system.
- User23 2y agoThat LLMs are subject to the fixed point theorem and the recusion theorem is definitely an under appreciated fact.
- KingMob 2y ago> Or an A.I. history tutor that ingests A.I.-generated propaganda and can no longer separate fact from fiction. This...is already the case. Nothing about LLM architecture is biased towards facts. If they're factual at all, it's only because most things written by people are true (to the best of their knowledge, anyway). There are certainly attempts to constrain LLMs to be more factual, but we still have a ways to go on those.
- abrichr 2y agohttps://arxiv.org/abs/2408.15240 https://arxiv.org/abs/2408.15240 > We demonstrate that when using Gemma-based verifiers on algorithmic and grade-school math reasoning tasks, GenRM outperforms discriminative verifiers and LLM-as-a-Judge, showing a 16-64% improvement in the percentage of problems solved with Best-of-N. Furthermore, we show that GenRM scales favorably across dataset size, model capacity, and inference-time compute.
- j45 2y agoIf the person using LLM isn't asking questions but helping with certain tasks like refining their own ideas they're putting in it can be a different experience. Maybe LLMs aren't meant to be factual to someone who doesn't understand the facts, and that's ok.
- Grimblewald 2y agoa good example of people not understanding what they're asking is where people showcase the whole "which is bigger? 9.11 or 9.9?" and of course a LLM will return 9.11 because in most contexts (chapters, versions etc.) it is the bigger number, but if you specify the context is fractional numbers then most models will correctly say 9.9 is bigger. A while ago I kept seeing people tout the conventional "9.11 is bigger" answer as proof that LLM's don't understand numbers and are bad at math. While this is still empirically true, I don't think most people understand these things as well as they believe they do either. Specifically, people don't understand how broad and ill defined their questions often are, and how much of their preconceptions need to be communicated for their questions to mean what they think they mean.
- reissbaker 2y agoColor me unsurprised that the New York Times is writing an article drumming up fear around synthetic data and training on the internet, and concludes that the solution is for "A.I. companies to pay for this data instead of scooping it up from the internet, ensuring both human origin and high quality . . . there’s no replacement for the real thing." This reads like an extended sales pitch rather than an article. It's true that if you train the same model on nothing but a limited set of its own output for 30 epochs, you're gonna get a shitty model (although 30 epochs of finetuning will result in a pretty bad model on most datasets smaller than the original one). But paying the New York Times isn't going to change that: you can already mark articles pulled from its domain as being high-quality, human-sourced data, even if you don't pay them. If they win their lawsuits, they might be able to force model trainers to pay them for it, but that doesn't have anything to do with model collapse.
- jay_kyburz 2y agoOMG, this the startup idea I have been pitching for 10 years, and everybody laughs at me when I pitch it. Newspapers need to pivot away from "telling stories about things that happen" in articles and headlines, to organizations that gather information into some large interconnected database. They should collect and record testimony from witnesses, press releases and statements. Court recordings and findings. They should be able to take any "fact" and trace back to who claimed it, where, and when. Then, when you have a solid foundation, you can put a front end on it with commentators musing on various topics, or digging deeper looking for meaning, or cause and effects. Newspapers could be the organizations we go to when we want to know who said what and when, and what happened as a result. They should be neutral, and trustworthy. The role of newspapers should be to record history as it happens.
- surfingdino 2y agoIsn't it what Google's mission is? "Our mission is to organise the world’s information and make it universally accessible and useful" https://about.google/intl/ALL_uk/ https://about.google/intl/ALL_uk/
- skybrian 2y ago
- renewiltord 2y agoIt's going to be fine. The tool is fantastic and still getting better. We have enough content already for the base models and then we can take care of the new stuff. It's going to be non-trivial but it'll work.
- jedberg 2y agoI had an idea a couple of weeks ago -- vintage data. Data that you could guarantee was not generated by AI. Stuff like scans of old microfiche archives, scans of rare but unpopular books found in old boxes and attics. Things like that. Free startup idea! Go to garage sales and look for boxes of books that maybe have never been digitized. Just be careful that the entire training set doesn't have the moral values of 100 years ago!
- at_a_remove 2y agoA bit like trying to find steel made before all of the atomic testing started, I suppose. You know, the Hathi Trust might not be a bad way to collect that data as a start.
- dimatura 2y agoI mean, I'm sure curated datasets that are guaranteed (within some margin of error, probably) to not have been AI-generated will be a valuable commodity, or rather already are. Maybe that would include old reddit posts/comments, not sure how far back you'd need to go. (You would know better than I).
- jedberg 2y agoThe problem with Reddit posts is that they might be edited. But if you limit yourself to non-edited comments from before 2022 you’d be good.
- WrongAssumption 2y agoAn old Reddit post is how we ended up with glue on pizza.
- guappa 2y agoBut how can you know your curated dataset isn't curated by an AI? After all the company providing it needs to make more money, and using people is costly.
- loeg 2y agoYeah, it's the same "low-background / pre-war steel" of training data metaphor that's been floating around for years.
- Sparkyte 2y agoAI's novelty is wearing off where it starts to fail to produce immediate growth to investors. Today's investors are caught up exploiting latest thing then burning out because they released something half baked.
- llamataboot 2y agoDisappointed they didn't even mention intentional data poisoning - we simply have no idea what trapdoors are being laid in training data yet to be ingested...
- fallous 2y agoNeal Stephenson's Anathem: “‘Early in the Reticulum—thousands of years ago—it became almost useless because it was cluttered with faulty, obsolete, or downright misleading information,’ Sammann said. “‘Crap, you once called it,’ I reminded him. “‘Yes—a technical term. So crap filtering became important. Businesses were built around it. Some of those businesses came up with a clever plan to make more money: they poisoned the well. They began to put crap on the Reticulum deliberately, forcing people to use their products to filter that crap back out. They created syndevs whose sole purpose was to spew crap into the Reticulum. But it had to be good crap.’ “‘What is good crap?’ Arsibalt asked in a politely incredulous tone. “‘Well, bad crap would be an unformatted document consisting of random letters. Good crap would be a beautifully typeset, well-written document that contained a hundred correct, verifiable sentences and one that was subtly false. It’s a lot harder to generate good crap. At first they had to hire humans to churn it out. They mostly did it by taking legitimate documents and inserting errors—swapping one name for another, say. But it didn’t really take off until the military got interested.’ “‘As a tactic for planting misinformation in the enemy’s reticules, you mean,’ Osa said. ‘This I know about. You are referring to the Artificial Inanity programs of the mid-First Millennium…’”
- jillesvangurp 2y agoThere's a similar theme running in his "Fall; or Dodge in Hell" book where a fake nuclear attack and subsequent social media storm leads to a collapse of the internet and the emergence of its replacement based on human or automated editors filtering out all the "crap". This then leads to confirmation bubbles where people believe whatever they want to believe because their edit streams lock them into whatever they want to hear. Ku clux klan like militias taking control of rural parts of "Ameristan" and people keep on remembering the victims of a nuclear attack that never happened. He published that book just before the first Trump administration. A lot of the stuff that probably seemed a bit overly dramatic at the time has actually happened. People disagreeing about the last election outcome would be a prime example of some alternate truth that seems hard to weed out. And a lot of that is of course fueled by quite intentional media coverage sponsored by the likes of North Korea, Russia, and China who have definitely been trying to militarize misinformation for quite some time and run bots on a large scale on social media platforms. As a social commentary, both books are spot on. Anathem is probably my favorite NS novel though I love them all. Also don't miss out on the definition of Bullshytt. Classic Neal Stephenson.
- surfingdino 2y agoYup. It's VIGO--the new business model of Value In-Garbage Out.
- mo_42 2y agoHumanity has bootstrapped itself out of a lot of BS over the centuries. There's a mechanism for discarding bad ideas. For example: Badly-designed boats just don't return. Ill-designed protection of cities means they'll be conquered. Scientific ideas that do not corroborate, will be discarded. etc. Our current approach to AI doesn't have this mechanism. In the past, humanity just implemented ideas: a city was built according to some weird idea and lasted centuries. So the original idea would spread and be refined by further generations. I guess we need to bring such a mechanism into the loop.