9 ms·
Where is "reason" in this model? A chain of semi-related thoughts isn't reason. LLMs need a set of axioms and formal logic to establish truthfulness of arbitrar
by akomtu 4y ago
Where is "reason" in this model? A chain of semi-related thoughts isn't reason. LLMs need a set of axioms and formal logic to establish truthfulness of arbitrary statements.
- jahewson 4y agoHumans manage to reason just fine with neither of these.
- akomtu 4y agoThose humans use loosy logic and loosy axioms, but even they intuitively get that logic and axioms are necessary.
- dwaltrip 4y agoPerhaps gpt has some form of loosy logic and loosy axioms? Not as good as a humans in many cases… but still present.
- dragonwriter 4y agoHumans more often use intuition, and then construct axioms to logically justify intuition.
- cscurmudgeon 4y agoThis is like saying humans aren’t made up of atoms but humans are made up of cells.
- simonw 4y agoIf you can figure out how to do that - extend an LLM with formal logic to establish truth v.s. fiction - you'll be solving something that so far the big AI labs have all failed to do.
- computerex 4y agoGpt-4 can do formal logic and symbolic manipulation. I really don’t understand your comment.
- simonw 4y agoI was responding to "LLMs need a set of axioms and formal logic to establish truthfulness of arbitrary statements." Anyone who figures out a way to "establish truthfulness of arbitrary statements" in large language models will be making a HUGE breakthrough.
- computerex 4y agoLanguage models can establish truthfulness in a formal logic system. There is a lot of literature that indicates this. Look at this for instance: https://openreview.net/forum?id=qFVVBzXxR2V https://openreview.net/forum?id=qFVVBzXxR2V And you can test this quite easily with a prompt like this. gpt-4 answers this correctly without any tuning: you have 2 boxes, box a and box b. Box a has 3 index cards, each with a giant letter printed in the middle with a small caption below the letter. Based on the contents of Box A and Box B, infer what the blank index card in Box B should most likely say The contents of box a: letter P, caption P:O letter T, caption T:S letter J, caption J:K The contents of box b: index card with O printed in the middle index card with S printed in the middle blank index card
- simonw 4y agoI interpreted "establish truthfulness of arbitrary statements" as referring to the challenge of telling things like if a statement like "mars has a population of 12 million" is truthful or not, given the available training data for the LLM.
- computerex 4y agoThat's also "solved". Yes models exhibit hallucinations, but chain of thought prompting and ReAct prompting improve accuracy on factual tasks greatly, particuarly in a data augmented generation setting. We are finding new and better ways to prompt language models. Scaling up the models even further will also improve performance.