5 ms·

Anyone who has actually built software using what the masses think is 'artificial intelligence' knows exactly how artificial and overhyped ML and AI are. Neural

Anyone who has actually built software using what the masses think is 'artificial intelligence' knows exactly how artificial and overhyped ML and AI are. Neural networks are a far cry from the magic they've been made out to be, and are nowhere close to as sophisticated as the brains of most animals. Cherry picking results makes for good marketing material, but that's pretty much where the usefulness ends. We still don't even understand how exactly brains work.

tensor 9y ago
Neural networks really are pretty magical for a lot of image based problems these days. The impact for text problems is so far decidedly not magical, though there are starting to be some tantalizing results in my opinion.
- brndnmtthws 9y ago
  More gimmick than magic. At best they can do a crappy job of emulating specific human behaviours on carefully curated training datasets.
  - oh-kumudo 9y ago
    > At best they can do a crappy job of emulating specific human behaviours ...With better performance than human, that is pretty magical.
    - brndnmtthws 9y ago
      In certain cases, perhaps. But that's the exception, not the rule. You can't simply apply a neural net to every problem and magically get great results.
  - infinite8s 9y ago
    What about Alpha Go Zeros approach of reinforced learning based on self play? Arguably the game of go has really simple, explicit rules, and evaluating the final end state is also easy, but it shows that with enough compute NNs can identify important features without supervision or labeling.
    - brndnmtthws 9y ago
      What about what about Given enough time, energy, and computing power, you could just precompute every possible outcome and call it a neural network. You'll be praised as a genius.
      - philipkglass 9y ago
        This is like saying "given enough time, energy, and computing power, you could just factor large semiprimes by exhaustive search." It's both true and uninteresting because nobody has or ever will have that much time, energy, and computing power.
      - chillee 9y ago
        Ah yes, I forgot. Deepmind just secretly computed all 10^100 board states for alphago... Neural nets have been very successful for a lot of things while also being overhyped, but dismissing it all as marketing hype is throwing the baby out with the bathwater.
      - Bjartr 9y ago
        Where "enough" is "more than is available in the universe". The number of outcomes you'd need to precompute exceeds the number of atoms in the universe.
    - a_imho 9y ago
      Arguably the game of go has really simple, explicit rules, and evaluating the final end state is also easy, but it shows that with enough compute NNs can identify important features without supervision or labeling. AFAIK we don't know how much of that generalizes.
- romaniv 9y ago
  I'd say this is more of a result of decades of trial and error in different architectures/topologies rather than some fundamental property of neural networks in general.

tensor 9y ago

Neural networks really are pretty magical for a lot of image based problems these days. The impact for text problems is so far decidedly not magical, though there are starting to be some tantalizing results in my opinion.

brndnmtthws 9y ago
More gimmick than magic. At best they can do a crappy job of emulating specific human behaviours on carefully curated training datasets.
- oh-kumudo 9y ago
  > At best they can do a crappy job of emulating specific human behaviours ...With better performance than human, that is pretty magical.
  - brndnmtthws 9y ago
    In certain cases, perhaps. But that's the exception, not the rule. You can't simply apply a neural net to every problem and magically get great results.
- infinite8s 9y ago
  What about Alpha Go Zeros approach of reinforced learning based on self play? Arguably the game of go has really simple, explicit rules, and evaluating the final end state is also easy, but it shows that with enough compute NNs can identify important features without supervision or labeling.
  - brndnmtthws 9y ago
    What about what about Given enough time, energy, and computing power, you could just precompute every possible outcome and call it a neural network. You'll be praised as a genius.
    - philipkglass 9y ago
      This is like saying "given enough time, energy, and computing power, you could just factor large semiprimes by exhaustive search." It's both true and uninteresting because nobody has or ever will have that much time, energy, and computing power.
    - chillee 9y ago
      Ah yes, I forgot. Deepmind just secretly computed all 10^100 board states for alphago... Neural nets have been very successful for a lot of things while also being overhyped, but dismissing it all as marketing hype is throwing the baby out with the bathwater.
    - Bjartr 9y ago
      Where "enough" is "more than is available in the universe". The number of outcomes you'd need to precompute exceeds the number of atoms in the universe.
  - a_imho 9y ago
    Arguably the game of go has really simple, explicit rules, and evaluating the final end state is also easy, but it shows that with enough compute NNs can identify important features without supervision or labeling. AFAIK we don't know how much of that generalizes.
romaniv 9y ago
I'd say this is more of a result of decades of trial and error in different architectures/topologies rather than some fundamental property of neural networks in general.