3 ms·
The more fundamental problem is the sheer size of them, and this is only going to get worse as models grow larger to become more capable. Being able to look at
by int_19h 4y ago
The more fundamental problem is the sheer size of them, and this is only going to get worse as models grow larger to become more capable. Being able to look at the state of individual neurons during inference is very convenient, but that does not by itself make it possible to really find out what's going on.