4 ms·
"A 5′ UTR language model for decoding untranslated regions of mRNA and function predictions" https://www.nature.com/articles/s42256-024-00823-9 https://www.natu
by westurner 3y ago
"A 5′ UTR language model for decoding untranslated regions of mRNA and function predictions" https://www.nature.com/articles/s42256-024-00823-9 https://www.nature.com/articles/s42256-024-00823-9
- westurner 3y ago"Language models can explain neurons in language models"; GPT-4 can help explain what GPT-2 neurons do: https://openai.com/research/language-models-can-explain-neurons-in-language-models https://openai.com/research/language-models-can-explain-neur... https://news.ycombinator.com/item?id=35877402 https://news.ycombinator.com/item?id=35877402 IDK if this is a practical limit to such research? From https://news.ycombinator.com/item?id=38753725 https://news.ycombinator.com/item?id=38753725 : >> "Challenges with unsupervised LLM knowledge discovery" (2023) https://arxiv.org/abs/2312.10029 https://arxiv.org/abs/2312.10029 : >> Abstract: We show that existing unsupervised methods on large language model (LLM) activations do not discover knowledge -- instead they seem to discover whatever feature of the activations is most prominent