3 ms·
I think this would be a valid objection if they stopped there. But then: “ Testing the neuron on a larger dataset” If I follow correctly, they test a bunch of
by theptip 4y ago
I think this would be a valid objection if they stopped there.
But then: “ Testing the neuron on a larger dataset”
If I follow correctly, they test a bunch of different completions that contain “an”. So they are not just detecting the bigram “an apple”, but the common activation among a bunch of “an X” activations where X is completely different.