8 ms·
Google says it'll scrape everything online for AI
- ForestCritter 3y agoArtists and writers are supposed to be ok with , why not everybody else?
- hightrix 3y agoSimply, if you provide a thing for free, expect people to take it and use it for free. Artists, writers, programmers, and everyone else included. If you do not want your “intellectual property” taken and used by others, don’t give it away for free.
- ForestCritter 3y agoArtists are expected to have online portfolio's of their work easily accessible for prospective clients and selection committees for any kind of shows or programs that they apply for. It is considered a mark of professionalism. Jpeg portfolios are too large to send like a resume. The very tool artists use to get work is being used to take work away from them.
- gAI 3y agoI'm not mad about it. Have at. Certainly AI can only benefit from my deep insights and hard-earned wisdom. I can see why some people are mad, though.
- palata 3y agoAre you writing content (like a blog)? Would you be fine if another website copied your blog without giving attribution, and people read from that one instead? Would you still write blog posts if people read a modified version of them through some AI system without ever knowing about what you wrote? Are you writing open source code? Would you still make it open source if people never saw it as "your" code, but instead paid an AI company to access your knowledge? Are you getting those strange internet points by answering StackOverflow questions? Will you still do it if people stop seeing the answers you redacted (and voting for them)? If it goes there, I will stop blogging, stackoverflow and open sourcing. And everything else that I do for free, just for the satisfaction of getting a "thank you" from a human from time to time. If AI wants to make me disappear, I will disappear.
- gAI 3y agoI wouldn't mind if this encouraged us to get offline and invest more time and attention in our local communities. I'm ready for the Star Trek future where we don't have jobs, and we do things for their inherent merit.
- Gigachad 3y agoWould I get mad if someone read my blog, learned things, and then wrote their own blog using some of these ideas? No.
- palata 3y agoBut that someone won't read your blog anymore, they will read a modified version on some AI frontend. Maybe modified in a way that alters your meaning. So not only you won't get any kind of attribution ("look how clever the AI is, it just learned the world and explained this to me"), but possibly your point won't get through the way you intended it.
- Gigachad 3y agoWhat some LLM spits out is not my post anymore. My post is still correct and as intended. Someone could read my post and retell their own version at the pub, that fine, it's their version.
- palata 3y agoBut the LLM won't say "please be careful, this is a modified version of Gigachad's post that you can read at <link>", will it? Don't you see a difference between 1) a human reading your blog post, understanding it, making their own opinion, and then sharing it under their name and 2) a machine taking your blog post as an input and distributing a modified version of it? Let's take two examples: First example: I create a blog that copy-pastes your posts to the word, but I don't give any kind of attribution, and I get money from it. Would you be fine with that, or would you consider that I should not be able to do it, because I am basically selling your copyrighted work without authorization? Second example: I do exactly the same as above, but I have a small script that will replace some words with synonyms. Is it now better than the previous example? Where do you put the limit? If the script is so good that you can't recognize your post anymore, then you find it okay? But that's still an automated script that just duplicates your blog and benefits from it, right?
- klyrs 3y agoWell that's an interesting reversal. Back when I was a kid, websites would have terms of services that their users were expected to follow. Now, web scrapers have terms of... consumption? Time to make a webring of Markov generated garbage to feed the bots...
- scarface_74 3y agoDid Google say they aren’t respecting robots.txt files?
- palata 3y agoDoes anyone respect robots.txt files?
- scarface_74 3y agoAny history of Google not respecting it?
- tpxl 3y agoAt this point, is there a way to protect your content from being thrown in the blender other than to not make it available publicly?
- TheChaplain 3y agoPerhaps something like AGPL but for text/documents?
- dragonwriter 3y agoLicenses alongside public content won't work because the reason people feel free to train is a legal theory that it does not require permission.
- palata 3y agoDo you really think that they don't train on AGPL code?
- dragonwriter 3y ago1. Win a lawsuit establishing that training AI is not fair use, or 2. Put it behind a click-wrap agreement that provides that it is provided to the user in exchange for an agreement not to use it to train AI. 3. For images, using on of the AI-poisoning techniques and publicizing that fact may encourage people to exclude your content from training sets; OTOH, it may backfire, especially against people looking specifically to defeat the AI poisoning technique in use. Otherwise, those operating under the theory that training AI is Fair Use will have no reason not you use the content for training AI.
- JohnFen 3y ago> Put it behind a click-wrap agreement that provides that it is provided to the user in exchange for an agreement not to use it to train AI. Such a thing is only as good as your ability to enforce it, though. Are you in a financial situation that allows you to afford to sue Google? I'm not.
- anjel 3y agoThe pirate in me dreams of the conversations I could have with libgen.ai
- euroderf 3y agoAre they using the contents of GMail email messages ?
- palata 3y agoThat is not public, I guess they are not. I mean not for the public-facing AIs. Obviously they use them internally.
- jacquesm 3y ago> I guess they are not For situations like this precision matters and guesses don't count.
- palata 3y agoWell, I would think that this is not yet solved. If AIs are allowed to use copyrighted open source code (without honoring the license terms) like they are currently doing, why couldn't they use copyrighted proprietary code, like the leaked sources of Windows? And if they can use leaked proprietary code, why couldn't they use basically everything they have access to, like your emails? In my opinion, it should all be forbidden, but you will find plenty of voices online that think AI should be able to (ab)use open source code, so...
- jacquesm 3y ago> In my opinion, it should all be forbidden We're fully in agreement there.
- damnesian 3y agoI remember the first time I really understood Google was using my "private" comms to sling ads at me. The writing on the wall seemed clear then. I just didn't know what the future endpoints were.
- throwaway888abc 3y agofrom new T&C For example, we may collect information that’s publicly available online or from other public sources to help train Google’s languageAI models and build *products* and features like Google Translate, Bard, and Cloud AI capabilities. Or, if your business’s information appears on a website, we may index and display it on Google services. https://policies.google.com/privacy/archive/20221215-20230701 https://policies.google.com/privacy/archive/20221215-2023070...
- paxys 3y agoNot scraping the public web is a competitive disadvantage, since OpenAI and others are definitely going to do it even if you don't. Unless there are new laws regulating it or some court setting a precedent under existing copyright laws, you can just expect all publicly viewable data online to be constantly training AI models.
- deleted 3y ago[deleted]
- palata 3y agoWhich is why we need laws, otherwise copyright is dead.
- yonatan8070 3y agoI'm thinking, what if someone would add in their blog's terms of use something like "the content on this blog is not for machine learning purposes"? Could they later sue Google if their site gets scraped by Google for LLM training?
- omoikane 3y agoIf those terms of use were machine readable, this would have been equivalent to something like robots.txt, but for AI. https://news.ycombinator.com/item?id=34324208 https://news.ycombinator.com/item?id=34324208 https://news.ycombinator.com/item?id=35886288 https://news.ycombinator.com/item?id=35886288
- anotherman554 3y agoA contract requires an agreement between two parties. I don't see how writing "the content on this blog is not for machine learning purposes" alone shows Google has agreed to your terms.
- hbn 3y agoNext you're gonna tell me the copy-paste Facebook statuses that say Facebook doesn't have rights to your photos don't do anything!
- spaced-out 3y agoThe US Supreme Court has already said no, see the case of LinkedIn vs. HiQ. https://www.fbm.com/publications/what-recent-rulings-in-hiq-v-linkedin-and-other-cases-say-about-the-legality-of-data-scraping/ https://www.fbm.com/publications/what-recent-rulings-in-hiq-...
- intesars 3y agoI recently started scraping internet for my own work. Unfortunately the sad part of using public data for AI is there is no references to the original work.
- pmontra 3y agoHow's that Google's privacy policy? It even applies to entities that have no relationship with Google. It's about those other entities' privacy policies (Google might ignore them) or a statement about Google's business practices.
- aerhardt 3y agoTry scraping at scale from them, I’m sure they would graciously take it as a fact of life in the open internet. You wouldn’t hear a word from their lawyers, no sir!
- costco 3y agoSerpapi.com has been around for several years now, in fact if you pay extra they agree to indemnify you against lawsuits by Google regarding scraping (as far as I can tell none have happened yet).
- kylehotchkiss 3y agoDoes this include google photos and google docs?
- gochi 3y agoNeither of those are end to end encrypted, so yes.
- mensetmanusman 3y agoThey have more than enough data for good models. Training good models that work is the hard part it seems.
- onetokeoverthe 3y ago[dead]
- slyall 3y agoWeird to see people get worked up about scraping the web for "AI" when search engine companies have been scraping the web for over 25 years. 99% of the time people's complaints about "permission" and "information accidentally made public" are the same arguments they have been using about search engines for years. Most of them have court cases even.
- palata 3y agoScraping the web to reference your copyrighted material is completely different from scraping the web to use your copyrighted material without any kind of attribution or respect for your copyright. If it is legal to do copyright laundering with AI, then copyright is dead. What's the point of writing a blog if people read it somewhere else, through an AI?
- slyall 3y agoThe problem is that a lot of the time the anti-AI people are complaining about the scraping itself. They say things "Downloading Copyright web content without permission" when thats what has been happening for years. As if scraping was a new and unusual thing. Google and other have always been doing a lot more than just creating an index. The opponents should attack the new stuff, not the other stuff that people have been doing for years.
- palata 3y ago> The problem is that a lot of the time the anti-AI people are complaining about the scraping itself. Source? That makes no sense to me. The problem is what being done with the copyrighted material, not the fact that an algorithm loaded it. Are you sure they complain about the scraping itself, or do you want them to complain about that, so that you can say that they make no sense?
- slyall 3y agoOpenAI Faces $3B Lawsuit Over Alleged Private Data Theft "The defendants are alleged to have conducted widespread web-scraping campaigns, violating various platforms' terms of service as well as state and federal privacy laws..." https://www.iotworldtoday.com/security/openai-faces-3b-lawsuit-over-alleged-private-data-theft https://www.iotworldtoday.com/security/openai-faces-3b-lawsu...
- fortyseven 3y agoI consider it like using photos in public. It's legal. People are being so weird about this.