Not quite what you’re asking for but perhaps in the direction https://openai.com/research/language-models-can-explain-neurons-in-language-models https://openai.

Not quite what you’re asking for but perhaps in the direction https://openai.com/research/language-models-can-explain-neurons-in-language-models https://openai.com/research/language-models-can-explain-neur...