3 ms·
Thank you! I've been pretty obsessively thinking about meta-science issues around interpretability for the last six months or so. :) A notable researcher priva
by colah3 7y ago
Thank you! I've been pretty obsessively thinking about meta-science issues around interpretability for the last six months or so. :)
A notable researcher privately told me that they think all interpretability research is nonsense. As someone who's dedicated the last six years of my life to this field, that was pretty uncomfortable to hear. But I think it's important to pay attention to, because I think it's actually a pretty common, unspoken view.
As a result, this has been on my mind a great deal. I think two important questions are:
(1) How can we surface the disagreements that are leading to such divergent views between different members of the research community? (Especially when people are generally too polite to say that they think something is total nonsense.)
(2) What would a more epistemically stable foundation for interpretability look like?
I'm not sure what the right answers to these are, but I think they're important to discuss.