2 ms·
We shouldn't need corporations for this anyway. Why can't we decentralize training? Model training à la folding@home.
by matheusmoreira 3y ago
We shouldn't need corporations for this anyway. Why can't we decentralize training? Model training à la folding@home.
- nvm0n2 3y agoTraining needs insane amounts of inter node bandwidth, to the extent that training clusters use specially built hardware for it. Decentralised training isn't physically possible anytime soon, maybe never.