3 ms·
> Running LLMs will be slow and training them is basically out of the question I think it's the reverse, the use case for these boxes are basically training an
by embedding-shape 1y ago
> Running LLMs will be slow and training them is basically out of the question
I think it's the reverse, the use case for these boxes are basically training and fine-tuning, not inference.
- kennethallen 1y agoThe use case for these boxes is a local NVIDIA development platform before you do your actual training run on your A100 cluster.