3 ms·
cocompute.ai is already doing this really well.
by darkpicnic 3mo ago
cocompute.ai is already doing this really well.
- SwellJoe 3mo agoIs it? I don't see anything on the website about splitting a model across multiple devices, only about putting local models on the internet, a wholly orthogonal problem (which is already easy with existing tools, since models use an http API).
- darkpicnic 3mo agoGood point. I know cocompute is working on splitting, but it’s not there yet; I was referring to the round-robin delegation within a trusted pool. Mesh LLM looks great too!
- dnoberon 3mo agoCool, always good to have more in the ecosystem. I love Iroh and hope this continues to succeed.