3 ms·
Is LLM inference mathematically reversible? If I say "42", can I drive that backwards through an LLM to find a potential question that would result in that ans
by whytevuhuni 3y ago
Is LLM inference mathematically reversible?
If I say "42", can I drive that backwards through an LLM to find a potential question that would result in that answer?
- willy_k 3y agoNot currently AFAIK. It is an active field of study though, mechanistic interpretability. https://arena3-chapter1-transformer-interp.streamlit.app/%5B1.2%5D_Intro_to_Mech_Interp https://arena3-chapter1-transformer-interp.streamlit.app/%5B...