5 ms·
The real news here is that They still use GPU to transcode their videos whilst other service such as search engine already use TPU for almost a decade now. I t
by 8K832d7tNmiQ 5y ago
The real news here is that They still use GPU to transcode their videos whilst other service such as search engine already use TPU for almost a decade now.
I thought they've already use custom chip for transcoding for decades.
- baybal2 5y agoThey were actually transcoding on CPUs before, not GPUs
- rland 5y agoGPUs have specialized hardware for video transcoding, no? So this actually makes sense. The product was already made (although, perhaps not up to Youtube's standard) by GPU manufacturers.
- numlock86 5y agoThe specialized hardware in GPUs is targeted at encoding content on the fly. While you could use this to encode a video for later playback it has a couple of drawbacks when it comes to size and quality, namely h264, keyframes, static frame allocations, no multipass encoding, etc. ... This is why video production software that supports GPU encoding usually marks this option as "create a preview, fast!". It's fast but that's it. If you want a good quality/size ratio you would use something like VP9 for example. Because of missing specialized hardware and internals of the codec itself currently this is very slow. Add multipass encoding, something like 4k at 60 frames, adaptive codec bitrates and suddenly encoding a second takes a over two minutes ... the result is the need for specialized hardware.
- rland 5y agoThat is interesting, I didn't know that. I thought that doing computation on the GPU sped up encoding for even the high quality presets.
- jng 5y agoIs there any solid information about Google using TPU for the search engine, or is this an assumption you're making?
- alarmingfox 5y agoThis[0] Google blog from 2017 states they were using TPU for RankBrain which is what powers the search engine [0] - https://cloud.google.com/blog/products/ai-machine-learning/google-supercharges-machine-learning-tasks-with-custom-chip https://cloud.google.com/blog/products/ai-machine-learning/g...
- JohnJamesRambo 5y agoAll that power to show me recipes that hemhaw around and spend ten paragraphs to use all the right SEO words. I feel like the Google results were better 20 years ago, what did they use back then before TPUs?
- londons_explore 5y agoThey had to get special permission from the US government to export TPU's abroad to use in their datacenters. The TPU's fell under ITAR regulations (like many machine learning chips). The US government granted permission, but put some restriction like 'they must always be supervised by an american citizen', which I imagine leads to some very well paid foreign security guard positions for someone with the correct passport... Read all that on some random government document portal, but can't seem to find it now...
- anonymoushn 5y agoRight, at a competing video site we had vendors trying to sell us specialized encoding hardware most of a decade ago.
- kungito 5y agoi think they do more general purpose things like downsampling, copyright detection etc which doesn't have globally available custom asics. i think gpus don't do encoding/decoding themselves, they have separate asics built in which do the standardised encodings
- boomlinde 5y agoAre TPUs particularly useful for this kind of workload, compared to specialized encoders/decoders available on GPUs?
- madeofpalk 5y agoYeah I was surprised that it's taken them this long to build custom hardware for encoding videos.