3 ms·
First, it requires exponential investment because > 1. The intelligence of an AI model roughly equals the log of the resources used to train and run it. Incre
by joshtbradley 2y ago
First, it requires exponential investment because
> 1. The intelligence of an AI model roughly equals the log of the resources used to train and run it.
Incremental improvements in intelligence require exponentially more resources. Only once that step is achieved can costs be reduced.
Second, intelligence is not the same as education. Education is specialized, intelligence is general. Every modern convenience around you is the result of intelligence.
- esperent 2y ago> The intelligence of an AI model roughly equals the log of the resources used to train and run it. Didn't Deepseek disprove this? They trained a roughly equal model on an order of magnitude less compute.
- Lerc 2y agoNo, advances in efficiency were always expected (and indeed required because of this 'law') The principle is that if DeepSeek had have spent 10 or 100 times as much as they did their model would have been a few times better. This rule is intended to be applied on top of all of the other advances.
- mvdtnz 2y ago> The principle is that if DeepSeek had have spent 10 or 100 times as much as they did their model would have been a few times better. If this is the case then OpenAI must have a model that is a few times better. Where is it?
- Lerc 2y agoIf they have one I presume it would be in one of their data centres. Are you implying that they might be hiding something by not releasing a new model based upon technology that's a month old?