12 ms·
"cost to use" != "cost to train" Elsewhere he says that model intelligence is determined by the log of the resources used to train it, and this relationship ha
by panarky 2y ago
"cost to use" != "cost to train"
Elsewhere he says that model intelligence is determined by the log of the resources used to train it, and this relationship has been constant for many orders of magnitude.
The implication is that it takes exponentially increasing investment to achieve a linear increase in intelligence.
Exponentially increasing costs sound like a bad thing.
But then he says the linear increase in intelligence generates exponentially increasing economic benefits.
Those exponentially increasing benefits sounds like they might justify the exponentially increasing costs.
- frotaur 2y agoOk, but according to this, linear investments generate linear increase in economic benefits. So why the need to go exponential?
- panarky 2y agoBecause increasing investments and profits linearly would mean sub-linear growth in intelligence. Since Sam's only shot at immortality is reaching ASI in the next few years, sub-linear isn't fast enough. The purpose of ASI isn't to generate economic benefits for everyone else. The purpose of everyone else's economic benefits is to generate the ASI so Sam can live forever.
- mvdtnz 2y ago> Elsewhere he says that model intelligence is determined by the log of the resources used to train it, and this relationship has been constant for many orders of magnitude. If this relationship is constant then you must have a way to quantify "intelligence" in such a way that it can be compared like this. Care to share it?