3 ms·
You are right that it is a bold claim but here is a relevant summary: https://en.wikipedia.org/wiki/Stochastic_parrot#Interpretability https://en.wikipedia.org/
by ozgung 1y ago
You are right that it is a bold claim but here is a relevant summary: https://en.wikipedia.org/wiki/Stochastic_parrot#Interpretability https://en.wikipedia.org/wiki/Stochastic_parrot#Interpretabi...
I think "The Platonic Representation Hypothesis" is also related: https://phillipi.github.io/prh/ https://phillipi.github.io/prh/
Unfortunately, large LLMs like ChatGPT and Claude are blackbox for researchers. They can't probe what is going on inside those things.