3 ms·
Scientific physics simulations - even the frontier models just engage in rationalization of obviously unphysical results instead of understanding the system. Th
by hgoel 2mo ago
Scientific physics simulations - even the frontier models just engage in rationalization of obviously unphysical results instead of understanding the system. They have the rote knowledge but fail to apply it unless their hand is held through the process.
- nextaccountic 2mo agoToday's models can just write code to run the simulation instead
- knollimar 2mo agoThey choose not to unless you beg them, and of course they double down on not running it once they suggest reasoning qbout it is sufficient.
- hgoel 2mo agoI am referring to doing exactly that. Realistic, scientifically useful simulations still require tuning all sorts of parameters based on physical intuition and understanding of the system being simulated. Both Sol and Fable/Opus 5 fail at it and either blow up the computation cost to levels that can't be processed realistically, or they invent a justification for a visibly unphysical result.