4 ms·
The value of YouTube for AI isn't making AI videos, it's that it's an incredibly rich source for humanity's current knowledge in one place. All of the tutorials
by ralph84 9mo ago
The value of YouTube for AI isn't making AI videos, it's that it's an incredibly rich source for humanity's current knowledge in one place. All of the tutorials, lectures, news reports, etc. are great for training models.
- Nextgrid 9mo agoIs that actually a moat? Seems like all model providers managed to scrape the entire textual internet just fine. If video is the next big thing I don’t see why they won’t scrape that too.
- monocasa 9mo agoAnd we're probably already starting to see that, given the semirecent escalations in game of cat and also cat of youtube and the likes of youtube-dl. Reminds me of Reddit's cracking down on API access after realizing that their data was useful. But I'd expect both youtube to be quicker on the gun knowing about AI data collection, and have more time because of the orders of magnitude greater bandwidth required to scrape video.
- deleted 9mo ago[deleted]
- jakeydus 9mo agoAnd reddit turned around and sold it all for a mess of pottage…
- satvikpendem 9mo agoSold being the operative word, rather than giving it away for free.
- monocasa 9mo agoWell, it is available for free either way. They pissed off their user base all for a horse that had already left the stable. https://academictorrents.com/details/2d056b22743718ac81915f25b094b6226668663f https://academictorrents.com/details/2d056b22743718ac81915f2...
- satvikpendem 9mo agoLook at their stock price. They are doing very well since IPO, and much of it was revenue from selling their data.
- monocasa 9mo agoGoogle's $60m/yr is the only thing keeping them profitable. Mozilla's business model isn't really something to emulate, even if the stock market doesn't really see it that way.
- satvikpendem 9mo agoNot really. Lots of companies have valuable data they sell and have been in business for decades just fine. It's even better for reddit because it's user generated so they don't even have to do anything. The users who left during the API debacle are not the vast majority of users which are generally casual and do not give a single shit about what happened, much as tech people like to think otherwise.
- monocasa 9mo agoThe causal users (to say nothing of the the massive uptick in bot traffic) are some of the more useless data from an AI training perspective.
- satvikpendem 9mo agoAgain, this is a techie take. Lots of people for example use ChatGPT for personal therapy and guess which subs their training data comes from, r/relationships etc. Those trying to use them for other means are comparatively less frequent.
- awesome_dude 9mo ago> Seems like all model providers managed to scrape the entire textual internet just fine Google, though, has been doing it for literal decades. That could mean that they have something nobody else (except archive.org) has - a history on how the internet/knowledge has evolved.
- jmb99 9mo agoScraping text across the entire internet is orders of magnitudes easier than scraping YouTube. Even ignoring the sheer volume of data (exabytes), you simply will get blocked at an IP and account level before you make a reasonable dent. Even if you controlled the entire IPv4 space I’m not sure you could scrape all of YouTube without getting every single address banned. IPv6 makes address bans harder, true, but then you’re still left with the problem of actually transferring and then storing that much data.
- earthnail 9mo agoFor now, you actually get pretty far with Tor. Just reset your connection when you hit an IP ban by sending SIGHUP to the Tor daemon. I did that when I was retraining Stable Audio for fun and it really turned out to be trivial enough to pull of as a little evening side project.
- tucnak 9mo agoIPv6 doesn't make it "harder," as they would typically ban whole /48 prefixes.