4 ms·
We observed the same thing here at Copper Robotics where we absolutely need to have good Cuda bindings for our customers and in general the lack thereof has bee
by gbin 1y ago
We observed the same thing here at Copper Robotics where we absolutely need to have good Cuda bindings for our customers and in general the lack thereof has been holding back Rust in robotics for years. Finally with cudarc we have some hope for a stable project that keeps up with the ecosystem.
The last interesting question at that point is why Nvidia is not investing in the rust ecosystem?
- adityamwagh 1y agoI was talking to one person from the CUDA Core Compute Libraries team. They hinted that in the next 5 years, NVIDIA could support Rust as a language to program CUDA GPUs. I also read a comment on a post on r/Rust that Rust’s safe nature makes it hard to use it to program GPUs. Don’t know the specifics. Let’s see how it happens!
- pjmlp 1y agoThey kind of are, but not in CUDA directly. https://github.com/ai-dynamo/dynamo https://github.com/ai-dynamo/dynamo > NVIDIA Dynamo is a high-throughput low-latency inference framework designed for serving generative AI and reasoning models in multi-node distributed environments. > Built in Rust for performance and in Python for extensibility, Says right there where they see Rust currently.
- adityamwagh 1y agoOh, pretty cool. I didn’t know about this development.