The advantages of having a single big memory per gpu are not as big in a data center where you can just shard things between machines and use the very fast inte

The advantages of having a single big memory per gpu are not as big in a data center where you can just shard things between machines and use the very fast interconnect, saturating the much faster compute cores of a non Apple GPU from Nvidia or AMD