5 ms·
I want to point out here that people do the same: a lot of the time we don't know why we thought or did something, but we'll confabulate plausible-sounding rhet
by stavros 2y ago
I want to point out here that people do the same: a lot of the time we don't know why we thought or did something, but we'll confabulate plausible-sounding rhetoric after the fact.
- sinuhe69 2y agoNot in math.
- TeMPOraL 2y agoYes in math. Formalisms come after casual thoughts, at every step.
- sinuhe69 2y agoWhat is a casual thought that you cannot explain in math?
- TeMPOraL 2y agoThat question makes no sense. You can explain anything in math, because math is a language and lets you define whatever terms and axioms you need at a given moment. (Whether or not such explanation is useful for anything is another issue entirely.)
- worldsayshi 2y agoCan you explain how intuition led you to try a certain approach?
- TeMPOraL 2y agoIs it enough if I hand-wave it with probability distributions, or do you want me to write out adjacency search in a high-dimensional space?
- mdp2021 2y agoIt's totally different: those formalisms are in a workbench, following a set of rules that either work or not. So, yes, that (math) is representative of the actual process: pattern recognition gives you spontaneous ideas, that you assess for truthfulness in conscious acts of verification.
- legel 2y agoMath comes from brains.
- HeavyStorm 2y agoThat's some misunderstanding of the human brain and thought process...
- LoganDark 2y agoThe split-brain experiment is one of my favorites! https://www.youtube.com/watch?v=wfYbgdo8e-8 https://www.youtube.com/watch?v=wfYbgdo8e-8
- btbuildem 2y agohttps://en.wikipedia.org/wiki/Peace_on_Earth_(novel) https://en.wikipedia.org/wiki/Peace_on_Earth_(novel)
- mdp2021 2y ago/Some/ people bullshit themselves stating the plausible; others check their hypotheses. The difference is total in both humans and automated processes.
- stavros 2y agoHow are you going to check your hypotheses for why you preferred that jacket to that other jacket?
- deleted 2y ago[deleted]
- DSingularity 2y agoIs that example representative for the LLM tasks for which we seek explainability ?
- stavros 2y agoAre we holding LLMs to a higher standard than people?
- f_devd 2y agoIdeally yes, LLMs are tools that we expect to work, people are inherently fallible and (even unintentionally) deceptive. LLMs being human-like in this specific way is not desirable.
- stavros 2y agoThen I think you'll be very disappointed. LLMs aren't in the same category as calculators, for example.
- f_devd 2y agoI have no illusions on LLMs, I have been working with them since og BERT, always with these same issues and more. I'm just stating what would be needed in the future to make them reliably useful outside of creative writing & (human-guided & checked) search. If an LLM provides an incorrect/orthogonal rhetoric without a way to reliably fix/debug it it's just not as useful as it theoretically could be given the data contained in the parameters.