2 ms·

R1 distills are still very very good. I've used Llama 405b and I would say dsr1-32b is about the same quality, or maybe a bit worse (subjectively within error)

R1 distills are still very very good. I've used Llama 405b and I would say dsr1-32b is about the same quality, or maybe a bit worse (subjectively within error) and the 70b distill is better.

potamic 2y ago
What hardware do you need to be able to run them?
- llm_trw 2y ago
  The distils run on the same hardware as the llama models they are based on llama models anyway. The full version... If you have to ask you can't afford it.