3 ms·
You call R1 a small model? It's a 671-billion parameter model.
by bufferoverflow 2y ago
You call R1 a small model? It's a 671-billion parameter model.
- elorant 2y agoThere are multiple variations of the model starting from 1.5B parameters.
- bufferoverflow 2y agoThose are distillations of the model.
- rsanek 2y agohave you used those? in my experience even the 70B distillation is far worse than what you can expect from o1 / the R1 available on the web
- elorant 2y agoNo, I haven't. I've used Perplexity's R1 but I don't know how many parameters it has. It's quite good, although too slow.