3 ms·
There absolutely are! Check out hivemind (https://github.com/learning-at-home/hivemind https://github.com/learning-at-home/hivemind), a general library for deep
by mryab 4y ago
There absolutely are! Check out hivemind (https://github.com/learning-at-home/hivemind https://github.com/learning-at-home/hivemind), a general library for deep learning over the Internet, or Petals (https://petals.ml/ https://petals.ml/), a system that leverages Hivemind and allows you to run BLOOM-176B (or other large language models) that is distributed over many volunteer PCs. You can join it and host some layers of the model by running literally one command on a Linux machine with Docker and a recent enough GPU.
Disclaimer: I work on these projects, both are based on our research over the past three years