3 ms·

I'm gonna check that book, I bet I will learn a lot. I sometimes wonder how we are going to solve the scaling problems around silicon and energy for this kind

by dsign 4y ago

I'm gonna check that book, I bet I will learn a lot. I sometimes wonder how we are going to solve the scaling problems around silicon and energy for this kind of AI applications. Think about this: a life-saving cancer drug may need to be custom-designed for a patient by using a few Giga-joules of energy to feed a data-center.

adastra22 4y ago
Most of the energy goes into building these models. Applying the model takes orders of magnitude less energy, and can run on efficient hardware that is optimized for that purpose. It's not going to take a gigaojoules of energy to infer custom solutions from a prompt.