3 ms·
Alibaba Cloud: AI Models, Reducing Footprint of Nvidia GPUs, and Cloud Streaming
- Havoc 1y ago>they already have developed their own CUDA-like support, that is not 100% compatible, but works well enough for their internal uses at Alibaba. I wonder whether that's inference or training.
- ekianjo 1y agoFrom what I could gather this was mostly for inference.
- daft_pink 1y agonot sure about everyone else, but i can’t justify sending my data workflows to china.
- rightbyte 1y agoDo you imply you can justify sending your data anywhere else?
- daft_pink 1y agoUnfortunately, it’s not affordable to run your own LLM yet, but since I work in a regulated industry, it can’t go to China. But you are correct the moment it becomes practical to do it in-house. It will be done that way.