3 ms·

"we constantly strive to enhance the performance and efficiency of our Mamba and Jamba language models." ... "The growing importance of multi-step reasoning at

by Hilift 2y ago

"we constantly strive to enhance the performance and efficiency of our Mamba and Jamba language models." ... "The growing importance of multi-step reasoning at inference time necessitates accelerators that can efficiently handle the increased computational demands." Unlike others, my main concern with AI is any savings we got from converting petroleum generating plants to wind/solar, it was blasted away by AI power consumption months or even years ago. Maybe Microsoft is on to something with the TMI revival.

beepbooptheory 2y ago
This has been a constant thought for me as well. Like, the plan from what I can tell is that we are going to start to spinning all this stuff up every single time someone searches something on google, or perhaps, when someone would otherwise search something on there. Just that alone feels like an absolutely massive load to bear! But its only a drop in the bucket compared to everything else around this stuff. But while I may be thirsty and hungry in the future, at least I will (maybe) be able to know how many rs are in "strawberry".
r3trohack3r 2y ago
Energy availability at this point appears (to me at least) to be practically infinite. In the sense that it is technically finite but not for any definition of the word that is meaningful for Earth or humans at this stage. I don't see our current energy production scaling to meet the demands of AI. I see a lot of signals that most AI players feel the same. From where I'm sitting, AI is already accelerating energy generation to meet demand. If your goal is to convert the planet to clean energy, AI seems like one of the most effective engines for doing that. It's going to drive the development of new technologies (like small modular nuclear reactors) pushing down the cost of construction and ownership. Strongly suspect that, in 50 years, the new energy tech that AI drives development of will have rendered most of our current energy infrastructure worthless. We will abandon current forms of energy production not because they were "bad" but because they were rendered inefficient.

by Hilift 2y ago

beepbooptheory 2y ago

This has been a constant thought for me as well. Like, the plan from what I can tell is that we are going to start to spinning all this stuff up every single time someone searches something on google, or perhaps, when someone would otherwise search something on there. Just that alone feels like an absolutely massive load to bear! But its only a drop in the bucket compared to everything else around this stuff. But while I may be thirsty and hungry in the future, at least I will (maybe) be able to know how many rs are in "strawberry".

r3trohack3r 2y ago

Energy availability at this point appears (to me at least) to be practically infinite. In the sense that it is technically finite but not for any definition of the word that is meaningful for Earth or humans at this stage. I don't see our current energy production scaling to meet the demands of AI. I see a lot of signals that most AI players feel the same. From where I'm sitting, AI is already accelerating energy generation to meet demand. If your goal is to convert the planet to clean energy, AI seems like one of the most effective engines for doing that. It's going to drive the development of new technologies (like small modular nuclear reactors) pushing down the cost of construction and ownership. Strongly suspect that, in 50 years, the new energy tech that AI drives development of will have rendered most of our current energy infrastructure worthless. We will abandon current forms of energy production not because they were "bad" but because they were rendered inefficient.