3 ms·

How does people using it offset the amount of energy used to train it? If I use three hundred pounds of flour learning to make pizza, the subsequent three hundr

How does people using it offset the amount of energy used to train it? If I use three hundred pounds of flour learning to make pizza, the subsequent three hundred pounds of flour I use making delicious pizzas doesn't make the first 300 go away. Am I misunderstanding the numbers?

serial_dev 1y ago
You don’t misunderstand the numbers, you misunderstand the point. If you flush your pizzas down the toilet, it’s a waste. If you feed 300 people with it, it’s not, even if you end up using the same amount of ingredients.
warkdarrior 1y ago
The cost of training has to be normalized by the number of users (or queries) that rely on that training. If you use 300 lbs of flour to learn, and 300 lbs of flour to make 300 pizzas, then the total flour cost is 2 lbs of flour per pizza.
TobTobXX 1y ago
Sure, it's a value calculation. If you're able to serve delicious pizzas afterwards, it was worth wasting the first kg (you might call it an investment). If you're able to bring value to millions of users, it was worth to invest a few GWh into training. You might disagree on the usefulness. I think, you shouldn't have wasted a kg of flour because I won't ever eat your pizzas anyway. But many (you, your guests, ChatGPT users) might think it was worth it.
ssalazar 1y ago
Its not offset, its amortized. Your effective flour / pizza is (300 + 300) / num_pizzas. The total marginal flour expended will go up as you make more pizzas, but the effective cost will actually go down as the upfront cost is amortized over lifetime usage.
Remnant44 1y ago
It doesn't make it go away. Using your analogy - if you used 300lb to learn and then only made 10 lb of pizza after that, it would be a pretty poor use of resources. If you instead went on to produce millions of pizzas for people and 30,000lb of flour, that 300lb you used to learn looks like a pretty reasonable investment.

serial_dev 1y ago

You don’t misunderstand the numbers, you misunderstand the point. If you flush your pizzas down the toilet, it’s a waste. If you feed 300 people with it, it’s not, even if you end up using the same amount of ingredients.

warkdarrior 1y ago

The cost of training has to be normalized by the number of users (or queries) that rely on that training. If you use 300 lbs of flour to learn, and 300 lbs of flour to make 300 pizzas, then the total flour cost is 2 lbs of flour per pizza.

TobTobXX 1y ago

Sure, it's a value calculation. If you're able to serve delicious pizzas afterwards, it was worth wasting the first kg (you might call it an investment). If you're able to bring value to millions of users, it was worth to invest a few GWh into training. You might disagree on the usefulness. I think, you shouldn't have wasted a kg of flour because I won't ever eat your pizzas anyway. But many (you, your guests, ChatGPT users) might think it was worth it.

ssalazar 1y ago

Its not offset, its amortized. Your effective flour / pizza is (300 + 300) / num_pizzas. The total marginal flour expended will go up as you make more pizzas, but the effective cost will actually go down as the upfront cost is amortized over lifetime usage.

Remnant44 1y ago

It doesn't make it go away. Using your analogy - if you used 300lb to learn and then only made 10 lb of pizza after that, it would be a pretty poor use of resources. If you instead went on to produce millions of pizzas for people and 30,000lb of flour, that 300lb you used to learn looks like a pretty reasonable investment.