3 ms·
The older generations had substantial docs; they were iirc basically MPLS on their L2. With a bunch of e.g. remote atomic verbs that even worked through to POWE
by namibj 3y ago
The older generations had substantial docs; they were iirc basically MPLS on their L2.
With a bunch of e.g. remote atomic verbs that even worked through to POWER9 hosts, great for throughout on fetch_and_add heavy (almost) wait-free data structures. Such as even just bump-allocating yourself a remote destination buffer to deliver your message to (in LLM context, this could e.g. be single-token granular output delivery from an MoE router to which GPU hosts that expert. The router spits out a ragged Tensor, and those parts can be delivered efficiently.).