3 ms·

Can the training be parallelized in a manner similar to SETI-at-home?

• nodja 4y ago
  Yes, hivemind trained a gpt 6B model like this. General model training https://github.com/learning-at-home/hivemind https://github.com/learning-at-home/hivemind Stable diffusion specific https://github.com/chavinlo/distributed-diffusion https://github.com/chavinlo/distributed-diffusion Inference only stable diffusion https://stablehorde.net/ https://stablehorde.net/