3 ms·
At least a TB of VRAM to load it in fp16. They distilled to smaller models, which do not perform as well, but can be run on a single GPU. Full R1 is big though.
by deepsquirrelnet 2y ago
At least a TB of VRAM to load it in fp16. They distilled to smaller models, which do not perform as well, but can be run on a single GPU. Full R1 is big though.
- nickthegreek 2y agofp16? I thought it was trained at fp8.