6 ms·
I’d argue that a factor in CUDA’s success is their army of in-house researchers which use CUDA to do novel things. Sometimes those things get turned into produc
by mastax 2y ago
I’d argue that a factor in CUDA’s success is their army of in-house researchers which use CUDA to do novel things. Sometimes those things get turned into products (OptiX) other times they are essentially DevRel to show off what the hardware can do and documentation for how to do it. Additionally I’m sure they use pre-release hardware and software and give feedback about how to improve it.
I don’t know what AMD has in mind for this acquisition but I could see there being a lot of value having an in house LLM team to create models for customers to build on, run in benchmarks, and improve their products.
- eightysixfour 2y agoYes, nvidia spends a lot of time and money developing software that induces demand for their GPUs.
- KeplerBoy 2y agoThe biggest frameworks are still from other players though. Pytorch, tensorflow and jax aren't funded by Nvidia.
- stanleykm 2y agoBut they are built on top of nvidia tooling and you can use nvidia tools to do more extensive profiling than other players offer.
- KeplerBoy 2y agoTrue, gotta love Nsight Systems and Compute. That's the first hurdle of working with AMD GPUs, I have no idea what the GPU is actually doing because there is no quality profiler.
- Conscat 2y agoIs Omniperf/Omnitrace not very good? I haven't used it, but I have been using Nsight Systems recently and it looks comparable to me at a glance.
- mcbuilder 2y agoNo way would any of those have any have bindings to backend libraries like cuDNN.
- fortran77 2y agoYeah but the frameworks use CUDA in their NVIDIA implementation , don’t they?
- eightysixfour 2y agoThat’s ignoring a huge swath of software nvidia uses to push industry forwards (in the direction they want it to go). Omniverse, Isaac, Metropolis, Rapids, etc.
- xyst 2y agoNvidia also spends a metric shit ton of money to make sure professors use and teach on their platform. I don’t remember any alternatives in uni. Maybe OpenCL but only lightly mentioned
- Izikiel43 2y agoOpencl is horrible compared to cuda
- helloericsf 2y agoOpenCL was discussed more frequently in classes about a decade ago. However, I haven't heard it mentioned in the last five years or so.
- deleted 2y ago[deleted]
- 2y ago
- Narhem 2y agoNo nvidia makes great tooling. Like as a startup if I had to pick a development tool AmD fails repeatedly while nvida tooling is like matlab level of usefulness. Those companies have money to make ‘nice’ things which open source software doesn’t have the time to do. For 100m you could probably make some pretty sweet clones if amd is hiring anybody to man that position.
- xzel 2y agoI’m not sure if I’m in the minority here but Matlab levels of tooling is an insult. Their guides were always two or three steps before being useful. Just enough to make you think whatever they were selling would solve your problems but never enough when really building a solution.
- Narhem 2y agoBefore visual studio code the laggyness of eclipse always pushed me to use notepad++. Which in turn pushed me away from Java.
- cosentiyes 2y ago> matlab level of usefulness that's a little harsh :D
- Dalewyn 2y ago>Those companies have money to make ‘nice’ things which open source software doesn’t have the time to do. I would posit it's a lack of will rather than time.
- lmpdev 2y agoMoreso lack of will to effectively mass organise Thousands of OSS devs would be willing to devote serious time to it, but can’t/won’t run the gauntlet of starting such a ludicrously large project from scratch It’s easy to contribute, difficult to be the one organising the contributions A real “where do I even begin” problem
- 2y ago
- cityofdelusion 2y agoThe success of CUDA is basically a dual effect of AMD devices being inefficient and bad for years, plus AMD having no answer to CUDA for a solid 7+ years while the foundations of GPGPU were being laid down. Mindshare shifts slowly.
- chidli1234 2y agoIt's an acquisition, usually for patents/IP. There will be layoffs.
- pjietr 2y agoI guess their growth strategy was mostly about hiring every Finnish person, or living in Finland (and then in other countries) with a PhD in some quantitative topic and then market the "we have xx PhDs as a consultancy for all your projects". So you probably are right that not all these are needed anymore?
- ahartmetz 2y agoAMD is (according to their own statements) in the process of picking up a lot of software manpower. And wages in Finland are European tier, not US West Coast. Why lay them off?
- Yizahi 2y agoBecause nobody has been fired or fiscally punished for firing excessive number of people? :) People are notoriously bad at predicting potential positives, so firing people means nobody can prove that something wasn't created. In reverse it is possible to blame people for overhiring because that can be supported by hard numbers.