2 ms·
My understanding is that can work for model inference but not for model training. https://github.com/bigscience-workshop/petals https://github.com/bigscience-w
by simonw 4y ago
My understanding is that can work for model inference but not for model training.
https://github.com/bigscience-workshop/petals https://github.com/bigscience-workshop/petals is a project that does this kind of thing for running inference - I tried it out in Google Collab and it seemed to work pretty well.
Model training is much harder though, because it requires a HUGE amount of high bandwidth data exchange between the machines doing the training - way more than is feasible to send over anything other than a local network connection.
- robertlagrant 4y agoAnd a lot of expensive data scientists.