I believe this is incorrect. Multiple nation states have the resources to build out the infrastructure to train models at the same scale as OpenAI is doing, an

I believe this is incorrect. Multiple nation states have the resources to build out the infrastructure to train models at the same scale as OpenAI is doing, and an even greater number of tech companies. I think this conversation is pretty much moot anyway - we don’t yet have distributed training for these models but I suspect it’ll arrive before long, at which point the level of compute required for orders-of-magnitude larger training sets will become available (e.g. Training@Home in the same way we had Folding@Home). Obviously you’d still need to provide the training data, and co-ordinate the distributed nodes, but it doesn’t seem insurmountable.