4 ms·
> This lack of meta-cognition is a big reason why this first generation of LLM-based products – ChatGPT, Stable Diffusion, GitHub Copilot – are expressed as cop
by amelius 3y ago
> This lack of meta-cognition is a big reason why this first generation of LLM-based products – ChatGPT, Stable Diffusion, GitHub Copilot – are expressed as copilots, as opposed to say autonomous assistants that can be relied upon to perform a task correctly. We encountered the same issue in our previous post about doing scientific literature meta-analysis with LLMs.
Is there any indication that a next generation of LLM-based products can solve the meta-cognition problem?
- tomrod 3y agoJEPA architecture seems promising, though my last review was about 4 months back.
- ukuina 3y agoBoth Sam and Yann have expressed desire to pursue the idea of asymmetric computational load, where "harder" problems emit or recurse through more tokens while "easier" problems (like retrieving tbe current date) use less tokens. This assumes there is a fixed amount of intelligence brought to bear for emitting each token.
- jcims 3y agoAnd that you can accurately determine difficulty and/or confidence.
- taberiand 3y agoSeems like passing the input with a question of "where should this input be handled?" into the LLM would be a good first step.
- Chinjut 3y agoWhy would the LLM be any good at determining where the input should be handled?
- explaininjs 3y agoThere's a long history of "this looks hard, I won't implement/fix it" in GitHub issues the LLM can train on.
- mynameisvlad 3y agoAnd then the LLM can probably know whether an issue can be fixed or not. That’s far from generalizing the problem though.
- dartos 3y agoLLMs have shown some limited ability to generalize. (Opinion) I think internally, they record how closely 2 words are in meaning based on the training data. If everyone uses similar language to describe different problems, then the LLM should be able to at least act like it’s generalizing
- deleted 3y ago[deleted]
- Metasky 3y agoThe first tasks of gpt was to evaluate the emotion of a sentence. Like determine if a comment/review is good or bad.
- astrange 3y agoGPT4 uses a "mixture of experts" system which is already sort of kind of like doing this.
- jejeyyy77 3y agocan probably easily be interpreted from the text?
- SketchySeaBeast 3y agoDid we just discover a new halting problem?
- babyshake 3y agoIt doesn't seem like this should be the case. Humans can estimate the complexity of a task without performing the task. Why couldn't an advanced LLM?
- SketchySeaBeast 3y agoIsn't a large part of software development's difficulty that people can't actually do that?
- bumby 3y ago>Humans can estimate the complexity of a task without performing the task. I would argue this ability drops precipitously as the complexity grows. That's part of the reason cost and schedule estimates are notoriously unreliable on big projects.
- uh_uh 3y agoAccurately or the way humans do it?
- benTherenBack 3y ago[dead]
- dmead 3y agoJust a meta comment here. When does a metaphor stop being a metaphor and start becoming a lie? Does it have to do with the speakers intention or can it just get away from you and nobody notices? Anyways. This problem isn't going to be solved.
- deleted 3y ago[deleted]
- dev1ycan 3y agoNot really, and it shows that LLMs just like prior attempts at generalized AI are gonna hit a wall, they're trying to brute force the issue which in my opinion won't work.
- toisanji 3y agothis paper explores combining metacognition with LLMs as the application level: https://replicantlife.com/ https://replicantlife.com/
- taormina 3y agoNot yet.