3 ms·
Craylm: Open-source unified LLM training and inference for R1
- gdiamos 2y agoSome of the authors are available to discuss the current code or the roadmap.
- gdiamos 2y agoSome interesting notes about the project if folks want to dig deeper: There is a dev mode that runs on a laptop: - https://docs.cray-lm.com/deployment/laptop There is a unified dockerfile for building vLLM and the training stacks on four targets [ROCm, CUDA, ARM, x86] - https://github.com/cray-lm/cray-lm/blob/main/Dockerfile