I don’t think Scott is serious about that (or if he is, he’s being uncharitable.) I think what the quoted speaker is saying is that nobody is able to keep up wi

I don’t think Scott is serious about that (or if he is, he’s being uncharitable.) I think what the quoted speaker is saying is that nobody is able to keep up with what these models are doing internally. Even OpenAI (and Meta et al.) only seem to be making “so much progress” by pressing the accelerator to the floor and letting the steering take care of itself. And one of the major lessons of technological progress is that deep understanding (at least when humans are necessary for that, gulp) is much slower than engineering, largely because the latter can be parallelized and scaled.