3 ms·
Nice follow up @ttanelpoder to "RAM is the new disk" (2015)[1] which we talked about not even two weeks ago! I was quite surprised to hear in that thread that
by rektide 6y ago
Nice follow up @ttanelpoder to "RAM is the new disk" (2015)[1] which we talked about not even two weeks ago!
I was quite surprised to hear in that thread that AMD's infiniband was so oversubscribed. There's 256GBps of pcie on a 1P butit seems like this 66GBps is all the fabric can do. A little under a 4:1 oversubscription!
[1] https://news.ycombinator.com/item?id=25863093 https://news.ycombinator.com/item?id=25863093
- electricshampo1 6y ago66GBps is from each of 10 drives doing ~6.6 GBps; don't think the infinity fabric is the limiter here
- rektide 6y agoI'd been going off this link[1] from the previous "Ram is the new diskx thread, but I think last time I read it I'd only counted one Infinity Fabric Inter-Socket on the 1P diagram (which provides the PCIe). On review, willing to bet, yeah, the pcie lanes aren't all sharing the one IFIS. The diagram is to give an idea, not the actual configuration. [1] https://en.wikichip.org/wiki/amd/infinity_fabric#Scalable_Data_Fabric_.28SDF.29 https://en.wikichip.org/wiki/amd/infinity_fabric#Scalable_Da...