However, I don't think we're anywhere even remotely within several orders of magnitude of entropy limits in the energy usage we use for AI models. I'm pretty c

However, I don't think we're anywhere even remotely within several orders of magnitude of entropy limits in the energy usage we use for AI models. I'm pretty convinced it shouldn't take several hundred megawatts to produce something like GPT-4. The human brain does it much more efficiently, and even that isn't near entropy limits.