5 ms·
There's no reasoning involved with LLMs. Please. Words have meaning.
by chx 3y ago
There's no reasoning involved with LLMs. Please. Words have meaning.
- m00x 3y agoUntrue, but also incorrect to call it an LLM. This is a VLM.
- ranguna 3y agoIsn't it a LMMM large mutli modal model?
- visarga 3y agocall it what you want
- ukuina 3y agoWhat makes you certain there is no reasoning involved here? Is it lack of "intent"? Does the user's prompt not provide sufficient intent to the LLM? Based on the demo linked in the article, you can specifically prompt "What is unusual about this image? Walk me through your reasoning step by step" and get a thorough understanding of the reasoning behind the LLM's response. So, yes, words do have meaning, and the word "reasoning" appears apt.
- _ugfj 3y ago[flagged]
- visarga 3y agoIt's not perfect but it can reason, or solve many more situations than trained on. Here is a paper demonstrating that GPT-4 can combine up to 5 skills from a set of 100, effectively covering 100^5 tuples of skills, while only seeing much fewer combinations in training on a specific topic. > simple probability calculations indicate that GPT-4's reasonable performance on k=5 is suggestive of going beyond "stochastic parrot" behavior (Bender et al., 2021), i.e., it combines skills in ways that it had not seen during training https://arxiv.org/abs/2310.17567 https://arxiv.org/abs/2310.17567
- exe34 3y agoHow can you tell? Or to avoid proving a negative, how would you measure if reasoning was involved?