3 ms·
The full one, sure, but there are quantizations runnable on far smaller machines.
by fragmede 2y ago
The full one, sure, but there are quantizations runnable on far smaller machines.
- aurareturn 2y agoThis was true before DeepSeek.
- radlad 2y agoQuantized models don't perform as well. The question was about running one of the cloud models.