3 ms·

Llama is worse than gpt4 because they are releasing models 1/50th to 1/5th the size. R1 is a 650b monster no one can run locally. This is like complaining an

Llama is worse than gpt4 because they are releasing models 1/50th to 1/5th the size. R1 is a 650b monster no one can run locally. This is like complaining an electric bike only goes up to 80km/h

thot_experiment 2y ago
R1 distills are still very very good. I've used Llama 405b and I would say dsr1-32b is about the same quality, or maybe a bit worse (subjectively within error) and the 70b distill is better.
- potamic 2y ago
  What hardware do you need to be able to run them?
  - llm_trw 2y ago
    The distils run on the same hardware as the llama models they are based on llama models anyway. The full version... If you have to ask you can't afford it.
deleted 2y ago
[deleted]