3 ms·
LLMs learn high-dimensional representations that capture conceptual relationships in their training data. They manipulate those representations in ways that app
by voidspark 1y ago
LLMs learn high-dimensional representations that capture conceptual relationships in their training data. They manipulate those representations in ways that approximate human reasoning.
- consumer451 1y ago> They manipulate those representations in ways that approximate human reasoning. Fwiw, this is the story of my life. Seriously.
- voidspark 1y agoLOL everyone is like that most of the time. System 1 vs System 2 thinking. System 1 is rapid, uses heuristics to make quick judgements. Not rigorous. System 1 is the default mode. System 2 is slow deliberate reasoning, energy intensive, and even humans get that wrong. LLMs often use something like System 1 pattern matching, get the answer wrong initially, then can be prodded into trying again with a System 2 approach (chain of thought). https://en.wikipedia.org/wiki/Thinking,_Fast_and_Slow https://en.wikipedia.org/wiki/Thinking,_Fast_and_Slow