4 ms·
Keep in mind too that to run DeepSeek R1 you'd need 768 GB, so essentially 4 tinyboxes.
by radlad 2y ago
Keep in mind too that to run DeepSeek R1 you'd need 768 GB, so essentially 4 tinyboxes.
- fragmede 2y agoThe full one, sure, but there are quantizations runnable on far smaller machines.
- aurareturn 2y agoThis was true before DeepSeek.
- radlad 2y agoQuantized models don't perform as well. The question was about running one of the cloud models.