12 ms·
Transparent memory offloading: more memory at a fraction of the cost and power
- bawolff 4y agoI'm confused. They invented a swap partition?
- Neil44 4y agoIt seems kind of, but better because memory can be compressed and/or paged out using a more advanced algorithm than before which assumes fast NVME's available to inform it's decisions.
- mpweiher 4y agoCompressed swap has also been around for ages. There's also been swapping to GPU memory (if free). There are also advanced page replacement algorithms. One interesting algorithm I read about a while back was using LZW not to compress swap, but to predict future page usage from past patterns. etc. etc. It's all still paging/swapping.
- dahfizz 4y agoThe interesting bit (to me) is the algorithm. They automatically detect how slow each available swap space is, and how sensitive a workload is to memory latency and then swap memory pages into compressed dram or nvme storage in an optimal way. So yes, it's "just swap space" but highly optimized.
- throwaway81523 4y agoNice, they have reinvented virtual memory and paging to disk.
- goodpoint 4y agoIndeed. The side describes TMO in bombastic terms, but this is just an incremental improvement to zram and swapping. Yet, a smarter algorithm to swap intelligently was long due.
- voz_ 4y agodid you even read this?
- _nhynes 4y agoI get that this comment might have struck a nerve with you, but the site guidelines specifically recommend not asking if the commenter read the article. > Please don't comment on whether someone read an article. "Did you even read the article? It mentions that" can be shortened to "The article mentions that." FWIW I don’t think that the parent comment is wrong, but rather over-generalizing. If you’re close to the project, I’d love to hear a proper rebuttal to what seems to be a common question.
- voz_ 4y agoThat's fair, I apologize. It struck a nerve because of how blase it was with dismissal, but I too am guilty of that at times, I suppose. Also, I am not close to the project at all - learned about it here.
- collegeburner 4y agoNo this is obviously something supposed to improve on virtual memory and paging to disk. It uses things like that but is supposed to work across a data center with a bunch of different stuff. Improvement for a specific case is not "reinvent".
- woleium 4y agoor "Meta re-invents swap disk"
- jhgg 4y agoYou should read the whole article, because TMO does differ from traditional swapping. Notably, swapping usually occurs during periods of extreme memory pressure, where as TMO will offload memory much sooner and more intelligently.
- bjornsing 4y agoSo… paging then? Slightly improved paging?
- heretogetout 4y agoOnly one way to know for sure!
- voz_ 4y agoIf only there was some way to know! Some kind of... hyperlink, with text, where the answers you seek were available in a language you know, English, perhaps?
- seoaeu 4y agoThe linked article practically goes out of its way to obscure how much this work is incrementally building on Linux’s existing paging design versus designing their own solution. Sure there’s a couple places that mention Linux defaults don’t work for them, but it isn’t all that clear how difficult it was to change things
- bjornsing 4y agoThanks for stating my opinion with such clarity. :) Why come up with these weird acronyms and try to sell it like it’s some entirely new idea? Why not just start that page with “We improved the virtual memory subsystem of the Linux kernel...” and take it from there? That would be both comprehensible and impressive. Everybody wants to come up with their own terminology from scratch nowadays, even for things that already have well established terminology. For those of us who understand a lot and want to systematize knowledge in our heads it’s such a drag.
- trhway 4y ago>Using a compressed-memory back end, TMO saves 7 percent to12 percent of resident memory across five applications. Multiple applications’ data have poor compressibility, such that offloading to an SSD proves far more effective. that in general sounds strange. My experience across different application types over more than 2 decades has been very different (not about SSD, i mean the compression in memory have been always a very efficient approach). > Specifically, machine learning models used for Ads prediction commonly use quantized byte-encoded values that exhibit a compression ratio of 1.3-1.4x. yep, i haven't used compression for that. That though calls for a question - how many of those models do FB have in memory. Any chance FB instantiates such a model for every user/request? :)
- gumby 4y ago> …i mean the compression in memory have been always a very efficient approach. It’s quite possible that a large amount of stuff FB handles is already compressed (e.g. photos, video, and audio) and thus doesn’t offer much opportunity for further compression. Though I wonder how much of that stuff would be memory resident in the back end in the first place.
- MarkSweep 4y agoComputer storage hierarchies are sure getting complex with CXL and NVM in the mix. https://en.wikipedia.org/wiki/Compute_Express_Link https://en.wikipedia.org/wiki/Compute_Express_Link
- hankman86 4y agoThe inevitable, albeit cynic response: Imagine how much DRAM could be saved if Facebook was shut down! Or put differently: I have only the greatest respect for the Facebook engineers who come up with innovations like this. This one seems to save cost, lowers power use and improves performance all at the same time. If only this engineering talent could be steered to better causes. Facebook is a net negative for society. Here is hoping that emerging “ethical” technology startups eventually have as great of success as surveillance juggernauts Facebook and Google enjoy today.
- Calvin02 4y ago>Facebook is a net negative for society Bold claim, Cotton. I personally have a hard time imagining a world where if Facebook didn't exist, something like it wouldn't either. There were plenty of companies vying for the same idea. Or is the suggestion that all usage of the internet to allow people to connect with each other are bad.
- hankman86 4y agoYou haven’t paid much attention in the last 10 years if you still think that Facebook is about connecting people.
- nindalf 4y agoYou haven’t paid much attention to the internet if you still think that allowing people a worldwide platform doesn’t have inevitable downsides. The internet is the same as the other mass media when it was newly invented. The printing press didn’t change how people were, it just allowed them to reach wider audiences. Without the printing press, Martin Luther is just a guy. Without Twitter, Trump is also just a guy. Facebook does connect people. Billions of people log in every day to see what their friends and family are up to. You might find that far fetched because you don’t know anyone who does, but that’s just your bubble. The issue with Facebook is that making communication free has consequences. Those consequences are what Facebook gets blamed for. But this would happen regardless because it’s a direct consequence of the internet making communication free.
- csdvrx 4y agoPersonally, I want to see PCIe x16 devices (or U2 NVMe) where you can plug a few sticks of RAM to get a temporary volume. It would be ideal for caching!
- GoOnThenDoTell 4y agoPlease build it! + oncard battery to survive reboots
- fulafel 4y agoWhat would be the advantage vs DIMMs?
- csdvrx 4y agoIn a server, you're more limited by DIMM slots than by PCIe ports, especially on EPYC considering the number of lanes available. With the shift towards DDR5, DDR4 could be repurposed as old servers are decommissioned.
- fulafel 4y agoI'm not convinced of the limited slots point - 16 (AMD) / 24 (Intel) DIMM slots in commodity single cpu socket server mobos, it gets you a few TB of RAM. 48 sockets in multi CPU socket mobos if you need more. I can see "recycling refurbished previous-gen DIMMs" working for certain cases but it sounds a bit niche unless someone productises it really well.
- sanxiyn 4y agoIf you are interested in Pressure Stall Information mentioned in the post, be sure to check LWN article on it, Tracking pressure-stall information: https://lwn.net/Articles/759781/ https://lwn.net/Articles/759781/
- fulafel 4y agoThis was added in back 2018, so we've had a while to start using it.. anyone have experiences of other tools using this information?
- SuperQue 4y agoWe added it to the Prometheus node_exporter ages ago. It's extremely useful in detecting system stalls. What I really need now is to have this information at the container level in cgroups v2. https://github.com/google/cadvisor/issues/3052 https://github.com/google/cadvisor/issues/3052 This metric will really help with measuring the impact of workload CPU bursting.
- MrYellowP 4y agoThis is far less impressive than they think it is, but I guess that's just how it is nowadays.
- fulafel 4y agoI wonder if there's public writeups / research into compressibility of web browser RSS, eg if there's a lot of JS objects they should exhibit a lot of regularity.
- sirjee 4y agoHow does this compare with Google's software defined far memory: https://research.google/pubs/pub48551/ https://research.google/pubs/pub48551/?
- hoseja 4y agoOh no don't bring back far pointers please.
- deleted 4y ago[deleted]
- faragon 4y agoThis is an important step for having better RAM overcommitment in Linux (avoiding OOM and having less latency spikes). I hope more effort is put in this line. /cc Google, Amazon, Red Hat, SUSE, Canonical