4 ms·

Stop trying to mimic brains. Do what works best for transistors.

• sva_ 2y ago
  It would be foolish not to look for inspiration in a system that had billions of years of evolution invested in it.
  • p1esk 2y ago
    We already found the inspiration. That’s how we invented neural networks. Now we need to focus on what works.
    • eru 2y ago
      It's good for some people to keep looking for more inspiration. Not just from brains, but also from all other aspects of the world. Eg dropout was (allegedly) inspired by our doubled up chromosomes and evolutionary selection.
    • dkersten 2y ago
      How do we know that current artificial neural networks aren’t the local maximum of modelling, and there isn’t a better model (biologically inspired or otherwise) that we haven’t explored yet? We need both to work on improving what we have that works, and to explore other avenues and inspirations (both to try entirely new things, and to improve the things we already have working in new ways). I don’t think it wise to throw out what we have working to try again with something biologically inspired, but I also don’t think it wise to say ok we’ve learned enough from biology, let’s focus purely on what we have now, when we don’t understand so much about biological brains, intelligence, and consciousness.
      • p1esk 2y ago
        let’s focus purely on what we have now That’s not what I said. Try different things, choose what works, as opposed to trying to imitate biology for the sake of imitating biology.
        • dkersten 2y ago
          I think we should imitate biology for the sake of imitating biology, though. Alongside other approaches. Right now, we know that biology works, because of animal and human intelligence. We don’t yet know if our other approaches have the ability to eventually lead to that.
  • hoseja 2y ago
    It's also full of legacy cruft. We can barely see three colors because some of our ancestors were nocturnal and we never regained the lost receptors [0] [1]. Look at that beautiful bird coverage of the spectrum, look at that awful barely orthogonal human M and L receptor. The blood vessels obstruct the retina in vertebrates! Methanogenesis hasn't been invented outside of Archaea! Also brain with higher cognitive functions (which everyone demands from these neural networks) is barely a couple million years old. Evolution works with copy-paste, rotate and change-single-character, and every single edit has to be compilable and viable. [0] https://en.wikipedia.org/wiki/File:BirdVisualPigmentAbsorbance.svg https://en.wikipedia.org/wiki/File:BirdVisualPigmentAbsorban... [1] https://en.wikipedia.org/wiki/File:Cones_SMJ2_E.svg https://en.wikipedia.org/wiki/File:Cones_SMJ2_E.svg
• kromem 2y ago
  Or grow beyond both with optics.
• smegger001 2y ago
  except copying biology (neural networks) has worked better than other approaches tried so far (reasoning as search, symbolic and semantic nets, expert systems...) so stick with whats working and we have a working reference model to study and we can build optimized hardware to match if it keeps working better than other methods