4 ms·
> Really though, LLM makers have only one true supplier: NVIDIA The argument relies on the axiom that NVIDIA will have a persistent hardware advantage. Maybe t
by WorkerBee28474 2y ago
> Really though, LLM makers have only one true supplier: NVIDIA
The argument relies on the axiom that NVIDIA will have a persistent hardware advantage. Maybe they will, but even if they were always 2 years ahead of the competition, if NVIDIA-trained LLMs would 'good enough' in 2025, then non-NVIDIA-trained LLMs would be 'good enough' in 2027.
- ljlolel 2y agoNo because that would compete with a 2025 model not state of the art.
- CharlieDigital 2y ago> NVIDIA will have a persistent hardware advantage Is it a hardware advantage? I think it probably has more to do with CUDA. The reason Python is the undisputed champion in AI and ML isn't because Python is a better, more performant programming language so much as because ecosystem of software in the AI/ML space is extremely concentrated, dense, and rich in the Python ecosystem compared to Java, Go, or C#. Likewise, it seems like NVDAs advantage isn't even necessarily the hardware but the suite of tools and software that are built up to take advantage of that hardware.
- YetAnotherNick 2y agoIt's definitely not CUDA advantage. If you can get Pytorch/flash attention/triton well supported in any hardware, a huge chunk of client don't care if it means cost saving. Case in point Google's TPU had extensive usage outside Google when they were cheaper for the same performance. Now that isn't the case.
- dehrmann 2y agoIt's TSMC more than NVIDIA.
- tomjohnneill 2y agoAnd it's ASML more than TSMC. Or maybe there's a highly profitable role for all the different parts of the value chain.