3 ms·

> Infiniband is an industry standard Infiniband is not an industry standard lol. Maybe it used to be, but it definitely is not anymore. Most Infiniband vendor

> Infiniband is an industry standard Infiniband is not an industry standard lol. Maybe it used to be, but it definitely is not anymore. Most Infiniband vendors are dead. The only product from those days that endures is Cornelis' Omnipath, and even that only emulated the Infiniband API back with its first gen, and then evolved to be its own thing. At this point, Infiniband is as good as a proprietary interconnect only sold by Nvidia/Mellanox.

ryao 2y ago
Infiniband is very much an industry standard: https://www.infinibandta.org/member-listing/ https://www.infinibandta.org/member-listing/ As far as I know, everyone is free to sign up with the infiniband trade association and implement the specification. Furthermore, if you use RDMA over Ethernet, you are using infiniband at a low level. RoCE which enables it was originally called Ethernet over infiniband. It is maintained by the infiniband trade association. Omnipath was Intel’s failed effort to try to kill an open standard. It purchased QLogic’s infiniband business, killed it in favor of omnipath and sold it when it failed.
- mrlongroots 2y ago
  > Furthermore, if you use RDMA over Ethernet, you are using infiniband at a low level. RoCE which enables it was originally called Ethernet over infiniband. This is wrong. RDMA over Ethernet is... RDMA over Ethernet. There is no Infiniband involved. RoCE was motivated by supporting RDMA, which was then an IB-only feature, over regular Ethernet. The user-level APIs are the same (verbs), but the underlying architecture is all different --- it is traditional Ethernet with link-level flow control to make it lossless (pause frames).
  - ryao 2y ago
    This is not what I have been told by others.
    - mrlongroots 2y ago
      Tip: copy-paste our entire exchange as a Gemini prompt and ask "who's correct?". (I did that yesterday and was very satisfied :) )
      - ryao 2y ago
        You are not the first person to say “the AI assistant liked what I said over what you said” to me on the Internet, to which I say they will tell you whatever you want to hear. I am not interested in continuing this discussion, but if you want to do your own research, I suggest starting with the fact that the Infiniband Trade Association controls the RoCE specification. I suggest you avoid using LLMs, for obvious reasons.

ryao 2y ago

Infiniband is very much an industry standard: https://www.infinibandta.org/member-listing/ https://www.infinibandta.org/member-listing/ As far as I know, everyone is free to sign up with the infiniband trade association and implement the specification. Furthermore, if you use RDMA over Ethernet, you are using infiniband at a low level. RoCE which enables it was originally called Ethernet over infiniband. It is maintained by the infiniband trade association. Omnipath was Intel’s failed effort to try to kill an open standard. It purchased QLogic’s infiniband business, killed it in favor of omnipath and sold it when it failed.

mrlongroots 2y ago
> Furthermore, if you use RDMA over Ethernet, you are using infiniband at a low level. RoCE which enables it was originally called Ethernet over infiniband. This is wrong. RDMA over Ethernet is... RDMA over Ethernet. There is no Infiniband involved. RoCE was motivated by supporting RDMA, which was then an IB-only feature, over regular Ethernet. The user-level APIs are the same (verbs), but the underlying architecture is all different --- it is traditional Ethernet with link-level flow control to make it lossless (pause frames).
- ryao 2y ago
  This is not what I have been told by others.
  - mrlongroots 2y ago
    Tip: copy-paste our entire exchange as a Gemini prompt and ask "who's correct?". (I did that yesterday and was very satisfied :) )
    - ryao 2y ago
      You are not the first person to say “the AI assistant liked what I said over what you said” to me on the Internet, to which I say they will tell you whatever you want to hear. I am not interested in continuing this discussion, but if you want to do your own research, I suggest starting with the fact that the Infiniband Trade Association controls the RoCE specification. I suggest you avoid using LLMs, for obvious reasons.