3 ms·

> Being able to mix what you have seen before But humans clearly do that. It's not all we do, but we clearly do that. And given the impressive results that L

• XorNot 3y ago
  I'd say possibly it is all we do, we just have a lot more hidden inputs. i.e. we're all dealing with inputs from our physical bodies now, and can't not be. There's a whole bit of social advice about dealing with people which is "remember you may be encountering someone on the worst day of their life" (the idea being, 95+% of the time you shouldn't escalate, particularly with strangers). What I do now, and how I think about things is being affected in ways I know are directly related to blood sugar, fatigue, pain (i.e. my legs are a little uncomfortable in a way yours aren't, but I moved them just now so they feel better - all unique inputs to me, all always there). But the other problem with the notion is people thinking of the knowledge bounds these systems derive as being "limits" - they're not. The whole point of machine learning is they're not interpolating between known datapoints, but rather extracting the rules which fit those data points. So stay between the points, and sure - it's some type of complex interpolation of seen inputs. But you don't have to stay between those datapoints - you can move of either end and extrapolate new ones entirely.
• Guvante 3y ago
  I would say LLM is at best a precursor for a memory system. But saying we almost have AGI because we have a template for HDDs isn't exactly representative IMHO.