Yes, hivemind trained a gpt 6B model like this. General model training https://github.com/learning-at-home/hivemind https://github.com/learning-at-home/hivemin

Yes, hivemind trained a gpt 6B model like this. General model training https://github.com/learning-at-home/hivemind https://github.com/learning-at-home/hivemind Stable diffusion specific https://github.com/chavinlo/distributed-diffusion https://github.com/chavinlo/distributed-diffusion Inference only stable diffusion https://stablehorde.net/ https://stablehorde.net/