4 ms·
I suspect YouTube would predict the popularity of videos and only cache where it matters (low anticipated popularity videos would be pushed to CDN if they perfo
by hsbauauvhabzb 6y ago
I suspect YouTube would predict the popularity of videos and only cache where it matters (low anticipated popularity videos would be pushed to CDN if they performed better than expected). YouTube-dl in some cases gets my full pipe speed, in others I see it as low as 100kb/s which is evidence to my theory.
That being said the data storage problem they have is insurmountable. I don’t think they ever delete low view-count content, so I’d be curious to know about their storage tradecraft.
- ma2rten 6y agoI remember in the early days this was very noticeable. Each time you watched a less popular video it would buffer in the beginning.
- 0xy 6y agoI experienced the opposite, because YouTube would allow their local caching servers in my ISP's datacentre to get congested. Popular videos wouldn't stream at all, but unpopular niche content was fine because it went straight out to the internet.
- Aerroon 6y ago>I suspect YouTube would predict the popularity of videos and only cache where it matters (low anticipated popularity videos would be pushed to CDN if they performed better than expected). That's actually a really interesting point, because YouTube can (partly) decide which video will become popular. They control what shows up as a suggested video, what appears at the top of search, what shows up in the subscription feed (unless the subscriber has clicked the bell icon).
- hsbauauvhabzb 6y agoThere’s probably a bunch of ML they could use. I was just thinking CDN anything from popular artists, or with the string minecraft in the title ;)