4 ms·
>This is all ignoring the fact that if the h800 was good enough amd's top line cards should be too. You can't pay me to use AMD cards. I have work to do. I don
by llm_trw 2y ago
>This is all ignoring the fact that if the h800 was good enough amd's top line cards should be too.
You can't pay me to use AMD cards. I have work to do. I don't have time to write drivers for cards that no one supports.
The point of the deepseek r1 paper is that the more synthetic data you generate by over trained models the better the resulting model. That means more GPUs. There is no reason why you can't train a dozen models like their nameless logic model in other domains and then use them for synthetic data augmentation.
- aurareturn 2y agoThe better the foundation model, the better the distilled thinking model. So yes, an increase need for ever better thinking models.