I think most of the critics here has to come from people not understanding that GPT-3 was not and will not be trained more than a few times. If even then you s

I think most of the critics here has to come from people not understanding that GPT-3 was not and will not be trained more than a few times. If even then you still want to argue, aluminum consumes 17,000kWh per ton ton which is 11 BERTs. I don't see weird criticism about mining consuming energy. Doing stuff takes energy and while the sentiment against ML seems to be "it's snake oil", it is still very real research with actual real-world impacts. Finally, we are in a transition phase where ML is done on GPUs which consume more energy than dedicated ASICs. We already have Google TPUs and Amazon Inferentia which can be used today. Power consumption will go down as dedicated hardware gets better and better.