4 ms·
> The inventions were partly understood mechanistically- just like ML We have effectively no mechanistic understanding of frontier ML systems, in the sense tha
by comp_throw7 3y ago
> The inventions were partly understood mechanistically- just like ML
We have effectively no mechanistic understanding of frontier ML systems, in the sense that we have no idea how they do what they do and could not e.g. write human-readable code to perform comparable tasks, nor can we predict ahead of time what capabilities such systems will have when they're trained (being able to predict e.g. log-loss is _not_ the same as being able to predict specific capabilities).