4 ms·
Is RDMA something worth looking into for connecting two random Linux computers? I've been extremely underwhelmed by the stability and performance of my NFS sha
by dlcarrier 3mo ago
Is RDMA something worth looking into for connecting two random Linux computers? I've been extremely underwhelmed by the stability and performance of my NFS shares.
- olavgg 3mo agoYes, nfs with rdma will increase your performance significantly.
- gorkish 3mo agoIf your storage devices are native PCIe and your network is actually fast enough and your nics and switches have the proper hardware and driver support and your switches are properly configured and your nfs client and server configurations are tweaked just so, and you hold your face in just the right position The perf is amazing
- dlcarrier 3mo agoI do have stable diffusion running on a non-Nvidia GPU, so I'm familiar with the manner of rituals required before contemplating installing system updates or even suspending the system. Now, I'm off to determine if an eMMC M.2 module is a native PCIe device…
- olavgg 3mo agoROCE do require proper nic/switch tuning. But if you go all in on Mellanox NIC's and switches, its basically on knob on the switch: roce If you buy CX3 and Mellanox SX6036(easy fan adjustment and low power usage) switches on Ebay for cheap. Which are great up to 56Gbps. You can run infiniband which is way easier to setup, just remember you still need to enable IP over IB to start the handshake for the RDMA connection.
- lmz 3mo agoThey also said something about stability, which I doubt would be improved by adding RDMA into the mix.
- esseph 3mo agoNFS 4.1 / 4.2?