8 ms·
Is there a guide to running these models locally? Sonnet level inference on my own hardware would be world changing. I have Claude but I don't want to ask it b
by matheusmoreira 5mo ago
Is there a guide to running these models locally? Sonnet level inference on my own hardware would be world changing.
I have Claude but I don't want to ask it because Anthropic could decide to sabotage me.
- angry_octet 5mo agoThey won't be giving this away, at least not for some years. It almost certainly has distillation data embedded in it, and that would be a smoking gun.
- matheusmoreira 5mo agoWhat? I just searched the web and the results say MiMo V2.5 Pro is fully open source. The weights seem to be out there. Distillation is not a problem.
- angry_octet 5mo agoThere are certainly open weights which are available, I don't know if that is what is running on the service.
- Bnjoroge 5mo agoI mean you can if you have the compute. They’re all open source