GPT-NeoX, which is a model from the same group but using GPUs instead of TPUs, uses techniques from DeepSpeed: https://github.com/EleutherAI/gpt-neox/ https://

GPT-NeoX, which is a model from the same group but using GPUs instead of TPUs, uses techniques from DeepSpeed: https://github.com/EleutherAI/gpt-neox/ https://github.com/EleutherAI/gpt-neox/