4 ms·
im talking per value. look at the efgiency of chinese open source models; then look at SOTA sucking gigawatts, then the proposals. America is basically proposi
by cyanydeez 6mo ago
im talking per value. look at the efgiency of chinese open source models; then look at SOTA sucking gigawatts, then the proposals.
America is basically proposing AI using the equivalent bloatware of Windows 11.
- bastawhiz 6mo agoI run two 49B parameter models on a pair of used A100s full time and it sucks down 250 watts at peak utilization. That's not gigawatts, and it's completely within the realm of comparison to what the author is describing.