3 ms·
"Language models can explain neurons in language models"; GPT-4 can help explain what GPT-2 neurons do: https://openai.com/research/language-models-can-explain
by westurner 3y ago
"Language models can explain neurons in language models"; GPT-4 can help explain what GPT-2 neurons do:
https://openai.com/research/language-models-can-explain-neurons-in-language-models https://openai.com/research/language-models-can-explain-neur... https://news.ycombinator.com/item?id=35877402 https://news.ycombinator.com/item?id=35877402
IDK if this is a practical limit to such research? From https://news.ycombinator.com/item?id=38753725 https://news.ycombinator.com/item?id=38753725 :
>> "Challenges with unsupervised LLM knowledge discovery" (2023) https://arxiv.org/abs/2312.10029 https://arxiv.org/abs/2312.10029 :
>> Abstract: We show that existing unsupervised methods on large language model (LLM) activations do not discover knowledge -- instead they seem to discover whatever feature of the activations is most prominent