8 ms·
"Minimize surprise" and "maximize accurate predictions" are the same thing mathematically. Minimize free energy = minimize prediction error. LLMs do everything
by FloorEgg 1y ago
"Minimize surprise" and "maximize accurate predictions" are the same thing mathematically. Minimize free energy = minimize prediction error.
LLMs do everything modelled in the free energy principle, they just don't do continuous learning. (They don't do perceptual inference after RL)
Your tone ("free energy thing" and "if you squint") comes off as dismissive and not intellectually honest. Here I thought you were actually curious, but I guess not?
- procaryote 1y agoPoor wording on my side, I'm sorry. Thank you for explaining your reasoning
- FloorEgg 1y agoThank you for saying that :)