6 ms·
Of course he does. Heck most of us in early stages of LLM did the same thing. The data simply did not exists outside Google which is why it’s crazy that Google
by lvl155 2y ago
Of course he does. Heck most of us in early stages of LLM did the same thing. The data simply did not exists outside Google which is why it’s crazy that Google completely dropped the ball on AI this decade. They had such a huge lead in terms data access.
- logifail 2y agoPerhaps the more interesting question would be exactly how did they obtain their copy/copies of Libgen?
- perfmode 2y agoAre you asking for a way to obtain a copy?
- logifail 2y agoNope, I have no need for any <whisper>further</whisper> copies. I'm more interested in how a for-profit corp decides to obtain a copy for development of a commercial product, and how they execute that ... whether they still have the data, and whether legal know about it :) It's exactly not the kind of thing you can say you "found on a USB stick lying around in the car park"...
- thfuran 2y agoYou should've seen the size of it. More of a USB baton really.
- selimthegrim 2y agoIf Ryobi and DeWalt can make Bluetooth speakers, ASP can get into USB drives.
- logifail 2y ago> You should've seen the size of it. More of a USB baton really. <glances at shelf with many, many external USB drives hooked up to a Pi 400> Oh, really? :)
- qingcharles 2y agoThere's torrents of it. I remember one AI company saying somewhere they just grabbed the big 7z torrent of it for their training.
- janice1999 2y agoIt's hinted at in the article. If they torrented one large dataset, it's likely they did the same for Libgen. > "I think torrenting from a corporate laptop doesn’t feel right,” wrote one engineer in April 2023, adding a smiley face emoji. (A later email acknowledged that the “SciMag” data had indeed been torrented.)
- llm_trw 2y agoAnd the only reason they had the data is because they scanned every book ever for Google books.
- pk-protect-ai 2y agoand every e-mail, and every document in google docs, and every video on youtube ...
- deleted 2y ago[deleted]
- tdb7893 2y agoThey dropped the ball on cloud and need to catch up and now it's AI. It's kinda interesting how being ahead with data center infrastructure and also AI research didn't lead to them being ahead on those products
- lvl155 2y agoTo be fair, they did have the lead as late as 2018. It’s just they treated it like it was their PhD thesis. Didn’t protect their IP at all and let all their talent leave.
- sitkack 2y agoGoogle is a playground funded by Ads and Ads make so much damn money that nothing can compete, even internally. If I were an activist investor, I'd make ads its own company. I was the FTC, I'd make ads its own company.
- whiplash451 2y agoAds fund Waymo.
- ripped_britches 2y agoAnd what are the other companies? Just GCP? Why separate those?
- xbmcuser 2y agoIn my opinion the Ai and absorbing all knowledge part of Google was Larry Page after his health scare his focus and priorities changed about actually living his life not Google. I think he had also realized what was happening with Google and so wanted Alphabet as an umbrella organisation but in the end he gave it up and let be run as a normal company.
- whiplash451 2y agoGoogle dropping the ball on AI… given their achievements on Waymo, Gemini and Gemma (just to name a few)… does not sound like a fair statement
- arresin 2y agoThose models are absolutely garbage. Terrible code understanding. Ridiculous hallucinations.
- thebytefairy 2y agoHave you actually used them recently? Gemini is top of chatbot arena, and Gemma is one of the best open models at its size.
- arresin 2y agoAnd that makes me extremely suspicious of that ranking. I use it at least a few times a week when I have a problem that’s unusual for me (to see it’s just terrible in my domain but not in others). It has a 9/10 fail rate. It is the best at OCR though. Not many people are talking about that. It’s a very nice thing to know.
- yencabulator 2y agoHow was the data Google already had access to any less protected by copyright? The data Google had was book scans, search engine indexing of arbitrary 3rd party content, and private email and documents they hosted.