3 ms·
People have been using their GPGPUs for decades on a variety of scientific applications, and there are all kinds of hybrid and multi-device frameworks that exis
by mgaunard 3y ago
People have been using their GPGPUs for decades on a variety of scientific applications, and there are all kinds of hybrid and multi-device frameworks that exist (often supporting multiple backends).
The difference is that it didn't get a lot of love as part of the overhyped python LLM movement.
- gdiamos 3y agoCompletely agree, I'd love to see some of the innovations from HPC move over into their LLM stack. We are working on it, but it takes time. Contributions to foundational layers like ROCBlas, pytorch, slurm, Tensile, huggingface, etc would help.