7 ms·

NotebookLM is contributing to fake podcasts across the internet, with over 1,300 and counting: https://github.com/ListenNotes/ai-generated-fake-podcasts/blob/m

• htrp 2y ago
  Only 1300? I imagine it would be soo many more.
  • wenbin 2y ago
    It’s definitely more than that. The 1,300+ shows are just the ones recently removed from Listen Notes. Give it a few days, and I’m sure the number will double, quadruple, and continue to grow. :(
• jsheard 2y ago
  > it also opens the door for spammers to mass-produce content that isn't meant for human consumption. What's new? Every novel class of genAI product has brought a tidal wave of slop, spam and/or scams to the medium it generates. If anyone working on a product like this doesn't anticipate it being used to mass produce vapid white-noise "content" on an industrial scale then they haven't been paying attention.
  • wenbin 2y ago
    This is definitely not a new issue. What I’m aiming for is to ensure that the NotebookLM team is aware of the impact and actively considering it. Hopefully, they are already working on tools or mechanisms to address the problem—ideally before their colleagues at YouTube and Google Search come asking for help to fight NotebookLM-generated spams :) It's certainly easier for the creators of genAI to build detection tools than for outsiders to do so. AI audio detection is a hard problem - https://www.npr.org/2024/04/05/1241446778/deepfake-audio-detection https://www.npr.org/2024/04/05/1241446778/deepfake-audio-det...
    • criddell 2y ago
      > What I’m aiming for is to ensure that the NotebookLM team is aware of the impact and actively considering it. What is the impact? Have any of them attracted an audience of any meaningful size? If a month from now there are 1.3 million generated podcasts, what do you anticipate the fallout to be?
      • sgdfhijfgsdfgds 2y ago
        > If a month from now there are 1.3 million generated podcasts, what do you anticipate the fallout to be? Is this a rhetorical question? Because the answer for podcast indexing and search services is surely pretty obvious.
        • criddell 2y ago
          Why is it a problem? There's even more material for those services now and for their customers, the value these services can provide is even higher.
          • ungreased0675 2y ago
            Wouldn’t the value be lower if podcasts end up the way product review blogs have? Endless spam that causes people to append “Reddit” to their searches in hopes of finding something human generated.
• deleted 2y ago
  [deleted]
• zooq_ai 2y ago
  Geez, I hope there aren't people like you working at Google
• newfocogi 2y ago
  This doesn't strike me as much of a problem as it appears for you. What are the biggest issues you foresee? I'm an avid podcast listener, but I already ignore 99.9% of podcasts out there. I'm not concerned that this is going to become 99.99%. If these AI generated podcasts are all bad, I will just continue to ignore them. If some turn out to be good, it seems like a win to me. If you're worried about an existential "what happens to the world if all media is machine generated", I guess I'm willing to hop on the ride and see what we find out.
  • ghshephard 2y ago
    99.9? There are roughly 3mm podcasts out there right now - I listen, regularly, to about 10 over a year (in any given week maybe 3-4). I'm therefore ignoring 2,999,990 or 99.9997% of podcast. I definitely agree with you that this isn't a problem. (Also - ironically, one of the podcast out of those 10 that I listen to regularly - it's the Deep Dive on AI. A NotebookLM production! )
    • frabcus 2y ago
      It could poison the well - make it hard for people to find new good podcasts, and reduce discovery and revenue. Also they could fragment our society even more, disconnect people from people. Doesn't seem worth the risk. If people want to listen to AI generated podcasts, they can just make them themselves. They don't need publishing on a platform alongside human-made podcasts. If I was Apple, who ultimately control curation of podcasts, then I'd prevent them. After all, Apple Intelligence will soon do as good a job of making your custom podcast if that's what you want.
      • oldpersonintx 2y ago
        [dead]
      • Ferret7446 2y ago
        How are all of the 99.99% podcasts that currently are not worth listening to not already poisoning the well? If the current ranking algorithms work, I don't see why it can't work with more podcasts, AI or not.
• scarface_74 2y ago
  So what do you propose Google do to prevent this from happening?
  • doctorpangloss 2y ago
    The comments' default remedy is tribal: "The only moral content is my content." We sort of used to live in that world under the studio and TV networks system. Most consumers would say, it was not so bad, maybe better even. Of course, the commenter never says this, living in the world today, where the writing he likes would never be published by the New York Times like it is on Twitter, the TV he likes would never be offered for free like it is on YouTube, and the music he likes would never been offered for pennies on Spotify. Some meaningful creators will lose from every remedy you could think of, where Google "something somethings" AI. Maybe the root problem is generalizing.
    • scarface_74 2y ago
      I created a “podcast episode” (???) of my personal blog (not trying to get traffic to it. It’s more of a journal) using NotebookLM. It sounded just as bland and overproduced as a “professional” podcast by NPR like “Planet Money” and “The Indicator”. Whether that is saying how high quality NotebookLM is or how low quality NPRs podcast are is an exercise for the reader. The only reason “Stuff you should know” is better is because of the random off topic discussions they go into and that’s not a complaint about SYSK.
    • deleted 2y ago
      [deleted]
• ghshephard 2y ago
  Where do you get the "low-quality" part from - my experience with NotebookLM is that they create much higher quality, more informative, more fact based, and more concise podcasts than 99% of the stuff I listen to. I've mostly switched entirely over to NotebookLM for my podcast listening. They, generally, offer a far higher quality experience from my perspective. Maybe you have the problem backwards - we accidentally end up listening to non NotebookLM podcasts?
  • 3abiton 2y ago
    It's interesting assumption that by virtue of being AI generated, it's considered bad/fake. 20 years ago, people hated how photoshop changed the photo design industry, NotebookLM is knocking on the door now.
    • ben_w 2y ago
      I'm excited by AI, but I've also tried using this specific one to generate a podcast based on one of my own blog posts and will only try again due to this product announcement rather than because I think the state of the art is already "there". On the plus side, the speech is almost perfect; so good, that I sincerely hope the voices themselves are never fully under user control. With regards to the actual summary of the content I gave them, I would say they are grade B: only mostly correct, they're still inventing things I didn't say and missing things I did say. That's not to say humans don't make mistakes, I still consider this objectively impressive, that is able to reach even this level was SciFi when I was a kid — but why waste time on a grade-B podcast when the AAA-tier costs you as a consumer a 30 second advert?
      • ryanjamurphy 2y ago
        There's an ethical/moral-luck dilemma at the heart of this. If a AAA-tier podcast on the subject you want to listen to a podcast about exists (and you know about it), then that's probably a better (and obvious) choice for your listening time. However, if you want to listen to someone discuss or explain something and you don't know about a AAA-tier podcast, it's possible that a generated podcast is better than nothing. On the other hand, it's also possible that the generated podcast will miss or hallucinate a key detail, and herein lies the dilemma. Is it better to listen to something that might get something wrong, or not to listen and perhaps someday to learn about the subject through some other form that is less likely to include mistakes?
• doctorpangloss 2y ago
  Podcasts - episodic radio shows hosted on Apple Music and Spotify - haven't been around for very long. Not long enough to have kids being tutored in making podcasts and then becoming adults with that sentimental hobby, like with playing violin or oil painting. If you believe that the "Human Authenticity Badge" is meaningful for podcasts, it's complicated: traditions play the biggest role in the outrage you are trying to spin, not an appeal to slop and spam, which of course, there is already a ton of low quality podcasts, music and art written by real people for no nefarious purpose whatsoever. Like with many of these posts, which are really common on HN, there isn't a sensible remedy suggested besides pointing the fingers at some giant corporation, and asking them to do something impossible. If you care a lot about podcast quality, go and make your own podcast service with better discovery. Once you realize the antagonist was collaborative filtering, made possible by non-negative matrix factorization dating from the year 2000, and not AI, you will at least have learned something from the comment, instead of just feeling better. And then, how do you propose to curate by hand, and why would someone choose your curation over the New Yorker's? And maybe those very purists, trying to make everything sentimental, accusing everyone of slop and spam - well, why do so many creators thrive and ignore the New Yorker's opinion about them entirely? Perhaps curation is not only not scalable, but also wrong. Difficult questions for listeners and podcast authors alike.
• groby_b 2y ago
  Counterpoint: Most podcasts were utterly worthless before AI too. The world will do fine losing a few mattress ad vehicles. Like other data, provenance suddenly matters a lot. From my POV, that's good. Not all data sources are created equal, and this is putting it into stark enough relief it might actually change the landscape. (In case it isn't obvious, I strongly believe most of the Internet was garbage well before LLMs. We just called it "SEO". Still garbage)
  • kredd 2y ago
    I generally agree, but when AI generated content is actively trying to avoid being labelled as “AI generated” it kinda gets depressing. Because in the end, it will just make the entire industry “seem” worthless, akin to AI generated pictures. I’d rather let the end user know if it was made by humans or not, and let the marker decide. If people love listening to such content, let it be. But hiding how it was made, feels a bit disingenuous.
  • sgdfhijfgsdfgds 2y ago
    > Counterpoint: Most podcasts were utterly worthless before AI too. Yet more "but humans also".
• tonygiorgio 2y ago
  This is like saying: “Text based LLMs should do more to stop people from publishing the results of what they produce” NotebookLM seems wonderful for digesting various content in an alternative way. It’s not a “fake podcast” either. Nobody is saying that the audio output should or should not be published somewhere. That’s a user decision for both publishing and subscribing. Indexes and discovery on the internet is where you advocate policing instead of nit picking a useful tool.
• bongodongobob 2y ago
  Well which one is it? Are the podcasts low quality or not? If they are, what the hell are you worried about? To be worried about, idk, disinformation from podcasts of all things is absolutely silliness. Won't someone think of the... podcast audiences? Fuckin what dude?
• wg0 2y ago
  It sounds more like we should ban email and all email providers should consider the problem of email spam which traditional mail didn't have because no one could afford that many envelops and stamps. Or like we should go back to carts because cars are noisy and not only that but might collide with pedestrians and not only that, might even collide among each other. Instead of containing the tools and curtailing the progress (email and cars) we should probably try to contain and curtail abusers. Very hard to do, I know but the right thing to do.
  • BlueTemplar 2y ago
    Paper mail does have an issue with spam too. Though I guess the differences in price and scale make a quantitative issue into a qualitative one, which I guess was your point ? You're assuming that everybody shares your opinion of cars being progress and/or progress being good - you're assuming too much.
• squigz 2y ago
  > Is there a watermark or any other identifiable marker that can be used? The problem with this is it's not feasible long-term, or even medium-term - as soon as a watermarking system is implemented, a watermark-removal system will be created. (Happy to be proven wrong)
• alvah 2y ago
  Assuming Google retain the current two voices for the audio overviews, it will rapidly become obvious to most people where the podcast came from. I've seen "creators" on YouTube running NotebookLM-generated audio through (e.g.) ElevenLabs to change the voices, but this invariably degrades the quality.
• whywhywhywhy 2y ago
  Nearly every Google Image search result has AI images now, personally I’m starting to attribute this to Image Search just having been neutered and downgraded a ton over the past few years anyway so worse content surfaces in general. But consider it from Googles perspective and this is why I think they won’t care, serving snippets and caches of articles had rights holders attacking them, serving thumbnails of images has rights holders attacking them, serving tiny bits of songs in the background of video had rights holders attacking them. Serving AI doesn’t, I don’t think the current management at Google will care if Google shows fake baby peacocks as long as it can serve them without being bothered by rights holders, same way a Gemini summery can launder article information.
• huijzer 2y ago
  Who cares? This is a problem for podcast hosters like Spotify, but not for listeners. Listeners can just follow their usual podcasts and never see 99% of the stuff that is out there.
• ActionHank 2y ago
  I cannot wait for them to feed this content back into the machine.
• KineticLensman 2y ago
  > a Hacker News post highlighted how nearly all Google image results for "baby peacock" are AI-generated Unfortunately Kagi image search is polluted with the same crap. I'd started to trust it recently but not so sure now. [Edit] This is true even when you specifically use the 'exclude AI' filter