2 ms·
It makes a world of sense if you think of it from a logistics point of view, especially considering Apple sells insane volumes of everything they sell. It cost
by faeriechangling 3y ago
It makes a world of sense if you think of it from a logistics point of view, especially considering Apple sells insane volumes of everything they sell.
It costs less to manufacture the current generation ship and the last generation chip concurrently, it allows them to push the newest generation chip out the door faster without running out of supply or having to open up excessive production lines.
>H100 vs apple silicon
while it's only one spec, H100 has over 2TB/s of memory bandwidth and Apple silicon caps out at 400GB/s. H100 in general kicks the pants out of Apple silicon performance and has far more support. These parts aren't really in the same league but Apple Silicon has become a popular hobbyist choice for LLM inferencing.
Also see: The Jetson AGX Orin 64gb, Nvidia RTX A6000 48gb, AMD Radeon Pro W7900 48gb, two nvlinked 24gb 3090's.