6 ms·
Zuckerberg Approved AI Training on Pirated Books, Filings Say
- asdefghyk 2y agoIts also reported elsewhere ( in media articles linked to by Hacker News ) they torrented copyright material. AMAZING
- ungreased0675 2y agoI would speculate this is true of all the leading commercial LLM models. Don’t have enough training data? Just steal some!
- Havoc 2y agoOn true for all - you’d need to split it by era I think During the early Llama 1 days The Pile dataset was in heavy use by many. Bit later people figured out that a subset of it - Books 3 - was especially problematic. I’m guessing all the big houses threw that piece out in later models since it’s extra radioactive
- gooosle 2y agoCopy some*
- dehrmann 2y agoCourts have yet to decide on which it is, and it might depend on how well the model can transform vs. recite.
- BSDobelix 2y agoThat's exactly the difference, one does not steal in the digital world. If i could download/copy a car i would do it ;)
- pera 2y agoIt depends who you are: - if you are an individual then it's called "pirating copyrighted work" - if you are a multi-billion dollar corporation then it's called "use of uncleared material for training"
- throw5959 2y agoIntent matters. I'm very happy we don't live in a world where it doesn't matter.
- taskforcegemini 2y agoone is personal use, the other is making money off of it?
- throw5959 2y agoMeta open sourced the result.
- bodiekane 2y agoIf we're going to use absurd hyperbole like "steal", I think we should just keep going further. Zuckerberg murdered some old library books to train a model. Zuckerberg genocided training data! Heck, everyone who read your comment here stole it. I'm so sorry for your loss.
- aprilthird2021 2y agoIt's not absurd hyperbole. If I took the text of, say the NYT Bestseller this week, stored the text along with various Projects Gutenberg books, then created a program to randomly deliver you a chapter from any such book. That would probably get me a lawsuit. This is just that with lots of levels of indirection.
- dekhn 2y agoI believe it was already known that anything trained on The Pile contained references to copyrighted material from scihub. It seems unlikely that folks who chose to use these sources were completely unaware of the nature of the data. Presumably, given the urgency in the last 2-3 years to be a leader in this space, a number of shortcuts were taken.
- deleted 2y ago[deleted]
- nobrains 2y agoZuck did a calculation: "Does the risk of lawsuits and bad PR outweigh the benefits of being early?". If u remove morals from the equation, nearly every CEO would have made that same decision if in that position.
- throw5959 2y agoYou talk about morals, but did you consider that they are releasing the model as open source, and given that OpenAI and others do the same, Zuck is really the only current option to have a reasonably comparable open source model? Also, did you consider that it might be more moral to create an AI model than to uphold copyright law, which actually many on this site deem immoral? IMHO this is a moral win on Zuck side.
- Havoc 2y agoStripping out the copyrights is quite damning. There is wrongdoing and there is obvious evidence that you known what you’re doing is wrong. That really limits options on Defence
- atulvi 2y agoGood. These laws are anti progress.
- ulfw 2y agoWhat "progress"?
- idiotsecant 2y agoWe're literally extracting, refining, and re-using the information, art, and thoughts of fellow humans to make billionaires money. This isn't the 90s. Computing isn't about discovery, not in the big leagues. Its about grinding up authenticity and feeding it into a machine to convert it into shareholder value. If they want the value, let them pay for it or release the models open source for all to benefit.
- archerx 2y agoThey have released all the models for free so far unlike other companies like OpenAI who are most likely doing the same but keeping it private and proprietary.
- vivzkestrel 2y agoStupid question: I have 400000 ebooks (yup pirated ones) what happens if I build an LLM with this?
- stuckkeys 2y agoNothing.
- solumunus 2y agoWhat do you imagine could happen?
- rcakebread 2y agoYou'd still ask stupid questions?
- deleted 2y ago[deleted]
- gooosle 2y agoYou go to jail forever.
- anothername12 2y agoYou’ll be fine. It’s like laundering money.
- blitzar 2y agoYou would have a net worth of 1bn
- covofeee 2y agoYou also need $100m to train it
- fooker 2y agoDepends on the parameter count. Too high? Straight to jail. Too low? Believe it or not, straight to jail.
- wil421 2y ago
- deleted 2y ago[deleted]
- musicale 2y ago"I'm shocked, shocked to find out that piracy is going on here!" "Your LLM, Captain Zuckerberg." "Oh, thank you very much!"
- udev4096 2y agoEveryone knows that LLMs are trained on shit ton of pirated content
- rurban 2y agoJail time? Or just multi-million fines. Will he be allowed to lead Meta if convicted as criminal?
- htrp 2y agoi was under the impression that almost everyone trained on books3
- cma 2y agoA book's copyright is no more valid than a website's
- alightsoul 2y agoGiven how things are going, maybe it will be ruled as "fair use" whereas something like controlled digital lending at the internet archive was ruled as "infringing" disgusting. So AI might become the only "legal" way to access a lot of knowledge for free you otherwise wouldn't have access to.
- palata 2y agoSame old story: Meta is too big to care. What will happen? A fine? Sure, they can pay.
- dudek1337 2y agoWhen I read about this I immediately thought about Aaron Swartz. He was persecuted for downloading copyrighted stuff, while Meta and other Corps will get a slap on a wrist. Such a sad story. And it's his death's anniversary today... RIP
- pointedAt 2y agough, that stuff from piratebay is full of errors and "pranks" #dataPoisoning