4 ms·
Those outputs are really good and come from deepseek-R1 (I assume the full version, not a distilled version). R1 is quite large (685B params). I’m wondering if
by comrade1234 2y ago
Those outputs are really good and come from deepseek-R1 (I assume the full version, not a distilled version).
R1 is quite large (685B params). I’m wondering if you can make a distilled R1 without the coding and math content. 7B works well for me locally. When I go up to 32B I seem to get worse results - I assume it’s just timing out in its think mode… I haven’t had time to really investigate though.