6 ms·
I got a Netflix cache server. 262TB
- metadat 4y agoI wonder what CPU and motherboard it's using. Probably a 2012 or 2013 era Xeon, but would be cool to get a definitive answer on exactly which internal components were selected.
- detaro 4y agothe specs are in the thread (well, not the exact motherboard, but pretty much everything else)
- js2 4y agoIt’s a SuperMicro X9SRL-F and Xeon E5 2650L: https://www.supermicro.com/products/archive/motherboard/x9srl-f https://www.supermicro.com/products/archive/motherboard/x9sr...
- metadat 4y agoWow, thank you kindly for the info.
- js2 4y agoIt's also got 4x LSI SAS9211-8I HBAs, so it's running 32 drives from the HBAs and the remaining 10 drives from the motherboard. I saw the original thread and couldn't figure out from the pictures how all those drives were wired up because I didn't know SuperMicro made motherboards with 10 SATA ports onboard. That's what got me curious about the exact MB. There's a link to imgur with the POST screen showing the model: https://old.reddit.com/r/homelab/comments/yddi1t/what_would_you_do_with_a_netflix_oca_cache_server/itt5aay/ https://old.reddit.com/r/homelab/comments/yddi1t/what_would_...
- mikerg87 4y agoThat looks suspiciously like a back blaze storage pod. https://www.backblaze.com/blog/petabytes-on-a-budget-how-to-build-cheap-cloud-storage/ https://www.backblaze.com/blog/petabytes-on-a-budget-how-to-...
- jonwest 4y agoIt does, but the Backblaze pod uses a backplane whereas this looks like it uses breakout cables which honestly kind of surprised me with the amount of drives in this.
- justsomehnguy 4y agoBackplanes are tricky and costly and in this case you need a custom one with sufficient power delivery. If you making a custom case for a fire-and-forget (and very rare HDD replacement, and in Netflix case - probably redundant on the node level) operation it makes sense to use breakout instead backplane.
- tmottabr 4y agobackblaze did used cables in at least one version of their storage pod, and they surely experimented with it before that.. and since netflix box known to have being inspired by earlier backblaze boxes it is not surprising they look similar..
- tmottabr 4y agoOne thing to add.. the version that blackblaze used direct cables the reason was that the backplanes they were using where the most unreliable part. this is something you can handle when all the servers are in your own DC like in blackblaze case. For netflix that need to built the server and ship it to someone else it makes more sense to go with direct cables as it would be more reliable and a cable problem would only affect a single driver, while the backplane will take 5 drivers out. also an regular sata cable is a easier part to source then a specific backplane..
- jonwest 4y ago
- MichaelZuo 4y agoHow many of these would be needed to hold their entire library?
- dilyevsky 4y agoAssuming 10-20k titles probably just one
- MichaelZuo 4y agoDo they really have so few titles? It's been a while since I last subscribed so my recollection my be fuzzy, but I remember they had easily over 500 unique sci-fi tv shows and movies alone.
- advisedwang 4y agoThey likely store the same video repeatedly with different resolutions/codecs/bitrates, so it might be fewer than expected
- dilyevsky 4y agoI was factoring that and error coding in my ballpark estimate
- lern_too_spel 4y ago
- hi 4y agoThis looks similar to the servers they use for their home grown CDN: https://youtu.be/tbqcsHg-Q_o https://youtu.be/tbqcsHg-Q_o
- shapefrog 4y agoIts a cache server from netflix. So I am not suprised it looks like a cache server from netflix.
- solotronics 4y agoIt would be interesting to save every single thing you ever see online to a local cache and index it using machine learning so you can search by topic. This is the kind of storage I imagine you could use for something like that.
- dirtyid 4y ago> ever see online Or ever seen. Screen record desktop at 1080p on codec optimized for text, maybe even grayscale with small samples of color data. Then have system index content (text, label graphics). When viewing, system will upscale, colorize, interpolate frames. Can probably throw in neural audio codec to store speech/audio.
- ksec 4y agoI think there are at least a dozens of comments on HN suggesting the same and 10x more upvote. It would be a great feature to add to a NAS.
- sanroot99 4y agoI have an idea to implement this technology ,it will just need a dns server ,routing techniques used in cdn and SSL decryption with custom cert
- deleted 4y ago[deleted]
- aa-jv 4y agoI do this by printing-to-PDF every web page I've ever read for longer than 30 seconds. 70,000+ files since 1997 .. its my own private internet. I take great delight in being able to grep for subjects through this directory ..
- OliverGuy 4y agoWhat do you use to do that?
- 4y ago
- tb_technical 4y agoI want one so flipping bad...