3 ms·
They kind of are, but not in CUDA directly. https://github.com/ai-dynamo/dynamo https://github.com/ai-dynamo/dynamo > NVIDIA Dynamo is a high-throughput low-l
by pjmlp 2y ago
They kind of are, but not in CUDA directly.
https://github.com/ai-dynamo/dynamo https://github.com/ai-dynamo/dynamo
> NVIDIA Dynamo is a high-throughput low-latency inference framework designed for serving generative AI and reasoning models in multi-node distributed environments.
> Built in Rust for performance and in Python for extensibility,
Says right there where they see Rust currently.
- adityamwagh 2y agoOh, pretty cool. I didn’t know about this development.