Inference? Yeah, it will probably only fit on Nvidia A100s. There are some other really cool accelerators out there that could theoretically run GPT, like the

Inference? Yeah, it will probably only fit on Nvidia A100s. There are some other really cool accelerators out there that could theoretically run GPT, like the Cerebras WSE2, Intel Gaudi 2, or Google TPUs, but Nvidia is so ubiquitious that its pretty much all anyone uses.