3 ms·

Not sure I understand the importance of this...

• juskrey 6y ago
  Indeed, CA can be represented by simple combinations of boolean functions, obviously by NN also, which is a combination of similar nonlinear functions.
  • benibraz 6y ago
    A wide enough NN can represent any arbitrary binary function, but it's not obvious that one can learn it.
    • labelbias 6y ago
      Yet the best NNs are deep, not wide.
      • benibraz 6y ago
        What do you mean by 'the best'? Deeper architectures are popular because they quiet easy to train. They do work well in practice on many tasks (especially vision) but they have their limits. Infinite wide networks are a newly active field and has recently shown some promising results, theoretically [1, 2] and empirically [3]. [1] https://arxiv.org/abs/2001.06931 https://arxiv.org/abs/2001.06931 [3] https://arxiv.org/abs/1806.07572 https://arxiv.org/abs/1806.07572 [2] https://ai.googleblog.com/2020/03/fast-and-easy-infinitely-wide-networks.html https://ai.googleblog.com/2020/03/fast-and-easy-infinitely-w...