3 ms·

> most professionals wouldn’t want to claim AGI for professional reasons Most professionals in my field would probably consider this a career-defining moment t

by z3c0 4y ago

> most professionals wouldn’t want to claim AGI for professional reasons Most professionals in my field would probably consider this a career-defining moment that would land one in the halls of the greats. I don't really follow this thinking. And I get the "looks like a duck, quacks like a duck" argument, but as I've repeatedly stated, that's not good enough. Frankly, I don't buy the "predictive coding" theory - at least, not to the extent that I believe the brain is only probabilistically modeling the phenomena it experiences. This ignores the glaring fact that our senses in-of-themselves exhibit some astounding capabilities right out-of-the-box, and predictive coding has no ground to stand on without the cross-referential analysis of the senses. Human babies are developing their intelligence long before any heavy stimuli. Hearing is the most active before birth, eyesight - our most rich sense - doesn't kick in until after birth. Nonetheless, babies come out of the womb with intelligent reflexes, such as rooting. That bundle of rudimentary intelligence is the basis upon which predictive coding begins - a functional default. An LLM is a set of statically-coded weights, incapable of context switching or object permanence. A child may take a while to understand the difference between "you" and "me", but they still can intuit "thing A" and "thing B". LLMs cannot - at least not without being paired with another model of some sort. And that model will be what tips the scale, not scaling up the features of what's merely a beautiful implementation of the logit function.

dr_dshiv 4y ago
Ok, so you don’t buy predictive coding for humans — that helps explain your position. You also see that some basic production rules (for basic reflexes) could mean the difference between AGI chatGPT and chatGPT today. Because of how it would help chatGPT orient towards the world, I suppose? I buy that critique because I do view a cybernetic loop as essential to intelligence — there must be some goalstate (however vague) to be achieved successfully. But, have you seen many claim that chatGPT is AGI? My issue is not with your argument (it’s good!) but the lack of acknowledgment for the reasonability of the position that chatGPT can be called AGI. Most people DO buy predictive coding. And many would view the missing “reflexes” in chatGPT just a matter of good UI/UX (for instance). Yet, I haven’t seen anyone stand up and systematically argue that chatGPT is AGI. (But I’m not on Twitter, so…)
- z3c0 4y ago
  I've considered that senses/reflexes may be supplemented with well-defined components feeding various signals together, but this is more of a challenge than it may seem at first. Wiring components of varying signal types together in a way that they can meaningfully be fed into the same vectorized input stream is no small feat (ie sound, images). We really underestimate the wonder of our nervous system. However, if that can be found out, I'm sure AGI would be right around the corner. Sometimes, I wonder if vectorized formats are even the answer at all. "Life is in analogue" after all. As for the assertions being made - at first, no, but once the Bing Search fiasco kicked off, I've seen more and more (here on HN) making the claim that ChatGPT and its kin are the beginning. Ultimately, it doesn't irk me - once we hit the same plateau as usual, the hype will boil down - but I do feel a bit concern at what may come of poorly-wielded LLMs before the industry wises up to their risks. A lot of people take ideas they see on HN back to their jobs, so we have a bit of responsibility to manage such hype here.
  - dr_dshiv 4y ago
    > manage such hype With hype I think of blockchain (wherein I never understood why removing people from decision-making through automated contracts was worth so much) or the metaverse (where I never understood how they envisioned a world with tech strapped to their face). The public communication about AGI isn’t exactly a hype cycle. People should, instead, be expecting a fairly dramatic change in many areas of life over the next 3-5 years.

by z3c0 4y ago

dr_dshiv 4y ago

Ok, so you don’t buy predictive coding for humans — that helps explain your position. You also see that some basic production rules (for basic reflexes) could mean the difference between AGI chatGPT and chatGPT today. Because of how it would help chatGPT orient towards the world, I suppose? I buy that critique because I do view a cybernetic loop as essential to intelligence — there must be some goalstate (however vague) to be achieved successfully. But, have you seen many claim that chatGPT is AGI? My issue is not with your argument (it’s good!) but the lack of acknowledgment for the reasonability of the position that chatGPT can be called AGI. Most people DO buy predictive coding. And many would view the missing “reflexes” in chatGPT just a matter of good UI/UX (for instance). Yet, I haven’t seen anyone stand up and systematically argue that chatGPT is AGI. (But I’m not on Twitter, so…)

z3c0 4y ago
I've considered that senses/reflexes may be supplemented with well-defined components feeding various signals together, but this is more of a challenge than it may seem at first. Wiring components of varying signal types together in a way that they can meaningfully be fed into the same vectorized input stream is no small feat (ie sound, images). We really underestimate the wonder of our nervous system. However, if that can be found out, I'm sure AGI would be right around the corner. Sometimes, I wonder if vectorized formats are even the answer at all. "Life is in analogue" after all. As for the assertions being made - at first, no, but once the Bing Search fiasco kicked off, I've seen more and more (here on HN) making the claim that ChatGPT and its kin are the beginning. Ultimately, it doesn't irk me - once we hit the same plateau as usual, the hype will boil down - but I do feel a bit concern at what may come of poorly-wielded LLMs before the industry wises up to their risks. A lot of people take ideas they see on HN back to their jobs, so we have a bit of responsibility to manage such hype here.
- dr_dshiv 4y ago
  > manage such hype With hype I think of blockchain (wherein I never understood why removing people from decision-making through automated contracts was worth so much) or the metaverse (where I never understood how they envisioned a world with tech strapped to their face). The public communication about AGI isn’t exactly a hype cycle. People should, instead, be expecting a fairly dramatic change in many areas of life over the next 3-5 years.