3 ms·
You do realize we're not training high end LLMs with even a few GPUs, but massive piles of them, right?
by pixl97 3y ago
You do realize we're not training high end LLMs with even a few GPUs, but massive piles of them, right?
- xyzzy3000 3y agoOf course. But a ban won't happen anytime soon - it will be in the future. We are seeing improvement in efficiency, and GPUs are getting faster. We have various methods for distribution of computing function. All of these trends mean that by the time the axe falls it will be far more feasible for smaller bands of geographically distributed hackers to put something together that defeats the regulatory regimes that are being proposed. And even if we aren't training models ourselves, execution of the large community models of the future will still benefit from GPU hardware.