3 ms·
> Because racks of H100s are not sustainable. Huh? Racks of H100s are the most sustainable thing we can have for LLMs for now.
by rfoo 2y ago
> Because racks of H100s are not sustainable.
Huh? Racks of H100s are the most sustainable thing we can have for LLMs for now.
- ilaksh 2y agoRight, they are. But they still use massive amounts of energy compared to brains. So it seems that we need a new paradigm of some sort. So much investment is being announced for data centers. I assumed there would be more investments in fundamental or applied research. Such as for scaling memristors or something.