4 ms·

> I think my choices today are POSIX sockets or DPDK. I hope for a day when I can try out this new fangled RDMA thing :-) It's fairly straightforward, you use

by cat199 8y ago

> I think my choices today are POSIX sockets or DPDK. I hope for a day when I can try out this new fangled RDMA thing :-) It's fairly straightforward, you use MPI, or code it yourself (so basically, you use MPI). https://wiki.mpich.org/mpich/index.php/MPI-3_RMA_Implementation_Timeline https://wiki.mpich.org/mpich/index.php/MPI-3_RMA_Implementat... https://www.open-mpi.org/faq/?category=openfabrics#roce-support https://www.open-mpi.org/faq/?category=openfabrics#roce-supp... maybe you use PVM, I think there are RDMA extenstions. But really, you probably use MPI.

abainbridge 8y ago
Interesting. I've never heard of MPI before. It looks like it is supported on Azure (https://docs.microsoft.com/en-us/azure/virtual-machines/linux/classic/rdma-cluster https://docs.microsoft.com/en-us/azure/virtual-machines/linu...). I'll look into it. Thanks.
- abainbridge 8y ago
  The "clusters" that support this have to be co-located in the data center - I guess they have to be on the same ToR switch or something. That gives less flexibility for deployment, meaning there's less chance of being able to spawn 50 new VM instances when you need to. Also I expect they cost more than VMs without RDMA support, whereas the DPDK support seems to be free. I'll hopefully get chance to do some experiments soon.