3 ms·
The next step in the research should be ablation of these time and space neurons to see how it affects accuracy on space/time completions which would help rule
by benlivengood 3y ago
The next step in the research should be ablation of these time and space neurons to see how it affects accuracy on space/time completions which would help rule out the memorization of linear probes.
- SiempreViernes 3y agoIt would also be reassuring if they showed that they couldn't reach similar performance when they assigned random values to the target coordinates and used non-spatial words.