4 ms·

Neural Network Quine

ttul 9y ago
What’s the significance of this paper?
- TekMol 9y ago
  Sex sells.
  - shoo 9y ago
    haha. alas, paper appears to cover asexual reproduction of neural networks only
    - avip 9y ago
      That'll be fixed when the Uni PR department issues the press release.
  - stanfordkid 9y ago
    Would be interesting to use this as a training algorithm -- have multiple self-replicating networks that mate and copy portions of their weights in random patterns... eerie.
    - RosanaAnaDana 9y ago
      Create fitness vectors based on their performance over to different problem types to create competition in the environment.
    - Choco31415 9y ago
      We already have the mating part with NeatAI. Link: http://nn.cs.utexas.edu/downloads/papers/stanley.ec02.pdf http://nn.cs.utexas.edu/downloads/papers/stanley.ec02.pdf Essentially it's a neural network which is represented by a series of genes. Genetically, new genes come in by having new links form between neurons, disabled, or split (with an in between neuron). This, as you can see, allows for a wide range of network representations. Because these variations are tagged with id's sequentially, we can mate two neural networks by combining their genes in order. They never conflict, and will produce something similar to both parents.
- crazyoscarchang 9y ago
  It's mostly interesting from an artificial life perspective. I'm just going to quote from the motivations sections here: Biological life began with the first self-replicator (Marshall, 2011), and natural selection kicked in to favor organisms that are better at replication, resulting in a self-improving mechanism. Analogously, we can construct a self-improving mechanism for artificial intelligence via natural selection if AI agents had the ability to replicate and improve themselves without additional machinery. Neural networks are capable of learning powerful representations across many different domains of data (Bengio et al., 2013). But can a neural network learn a good representation of itself? Self-replication involves some level of self-awareness, and is a small step towards developing introspective capabilities in neural networks. In a HyperNetwork (Ha et al., 2017), a small recurrent neural network is used to generate the weights for a larger one, which can be viewed as a meta-controller enforcing a soft weight-sharing constraint between layers of a recurrent neural network. Similarly, we can view self-replication as a mechanism that enforces a soft weight-sharing constraint between a network and past versions of itself, which is helpful for lifelong learning (Silver et al., 2013) and potential discovery of new neural network architectures. Learning how to enhance or diminish the ability for AI programs to self-replicate is useful for computer security. For example, we might want an AI to be able to execute its source code without being able to read or reverse-engineer it, either through its own volition or interaction with an adversary. Self-replication functions as the ultimate mechanism for self-repair in damaged physical systems (Zykov et al., 2005). The same may apply to AI, where a self-replication mechanism can serve as the last resort for detecting damage, or returning a damaged or out-of-control AI system back to normal.
  - romaniv 9y ago
    >Biological life began with the first self-replicator I never understood why people assume that those biological self-replicators were in any way analogous to quines. Quines generate information from within themselves. Proto-life would have to assemble copies of itself from molecules available in the environment. It seems like completely different principles of work.
    - jachee 9y ago
- burkaman 9y ago
  1. It's cool. 2. "We suggest that a self-replication mechanism for artificial intelligence is useful because it introduces the possibility of continual improvement through natural selection."
- visarga 9y ago
  > What’s the significance of this paper? We're progressing from static neural nets (like the old TensorFlow) to dynamic nets (like PyTorch) and even dynamically generated on-the-fly neural nets (hypernets) which is great for creating architectures that better fit the problem, case by case. This paper shows another way to generate a net from a net, but this time with self replication. Self replication could be useful for evolutionary optimisation, and, as they say in the paper, could become a rudimentary form of introspection. The idea of a "self-replication loss term" is very exciting, it's rare that we see such innovation in loss functions.
OtterCoder 9y ago
Quine, the descriptor in the actual article, is both more accurate, and more appropriate for a forum made of programmers. The fact that they made it into a quine with non-trivial, useful side effects is actually really interesting, regardless of the language/paradigm.
deleted 9y ago
[deleted]
_0ffh 9y ago
Isn't this essentially looking for a fixpoint?
- vanderZwan 9y ago
  > In mathematics, a fixed point (sometimes shortened to fixpoint, also known as an invariant point) of a function is an element of the function's domain that is mapped to itself by the function. https://en.wikipedia.org/wiki/Fixed_point_(mathematics) https://en.wikipedia.org/wiki/Fixed_point_(mathematics) Looks like it. And they need to resort to some mathematical trickery to achieve this because as the explain in the paper: > A neural network is parametrized by a set of parameters Θ, and our goal is to build a network that outputs Θ itself. This is difficult to do directly. Suppose the last layer of a feed-forward network has A inputs and B outputs. Already, the size of the weight matrix in a linear transformation is the product AB which is greater than B for any A > 1.
popcorncolonel 9y ago
So genetic programming, but for NN's? Hasn't that been done?
- qiemem 9y ago
  GP for NNs has, but this isn't GP; "self-reproduction" (as in the original title) here means that the neural network is learning to output a copy of itself. In other words, the NN is learning to be a quine (as indicated by the current title). This is a very different than just applying genetic programming to NNs. In GP, you're updating the NN (or whatever) by copying it with mutations/recombinations. Here, the NN itself is learning to create a copy of itself. The fact that they manage to also train to the network to simultaneously perform somewhat complicated tasks is super crazy.
std_throwaway 9y ago
This is a tautology.

ttul 9y ago

What’s the significance of this paper?

TekMol 9y ago
Sex sells.
- shoo 9y ago
  haha. alas, paper appears to cover asexual reproduction of neural networks only
  - avip 9y ago
    That'll be fixed when the Uni PR department issues the press release.
- stanfordkid 9y ago
  Would be interesting to use this as a training algorithm -- have multiple self-replicating networks that mate and copy portions of their weights in random patterns... eerie.
  - RosanaAnaDana 9y ago
    Create fitness vectors based on their performance over to different problem types to create competition in the environment.
  - Choco31415 9y ago
    We already have the mating part with NeatAI. Link: http://nn.cs.utexas.edu/downloads/papers/stanley.ec02.pdf http://nn.cs.utexas.edu/downloads/papers/stanley.ec02.pdf Essentially it's a neural network which is represented by a series of genes. Genetically, new genes come in by having new links form between neurons, disabled, or split (with an in between neuron). This, as you can see, allows for a wide range of network representations. Because these variations are tagged with id's sequentially, we can mate two neural networks by combining their genes in order. They never conflict, and will produce something similar to both parents.
crazyoscarchang 9y ago
It's mostly interesting from an artificial life perspective. I'm just going to quote from the motivations sections here: Biological life began with the first self-replicator (Marshall, 2011), and natural selection kicked in to favor organisms that are better at replication, resulting in a self-improving mechanism. Analogously, we can construct a self-improving mechanism for artificial intelligence via natural selection if AI agents had the ability to replicate and improve themselves without additional machinery. Neural networks are capable of learning powerful representations across many different domains of data (Bengio et al., 2013). But can a neural network learn a good representation of itself? Self-replication involves some level of self-awareness, and is a small step towards developing introspective capabilities in neural networks. In a HyperNetwork (Ha et al., 2017), a small recurrent neural network is used to generate the weights for a larger one, which can be viewed as a meta-controller enforcing a soft weight-sharing constraint between layers of a recurrent neural network. Similarly, we can view self-replication as a mechanism that enforces a soft weight-sharing constraint between a network and past versions of itself, which is helpful for lifelong learning (Silver et al., 2013) and potential discovery of new neural network architectures. Learning how to enhance or diminish the ability for AI programs to self-replicate is useful for computer security. For example, we might want an AI to be able to execute its source code without being able to read or reverse-engineer it, either through its own volition or interaction with an adversary. Self-replication functions as the ultimate mechanism for self-repair in damaged physical systems (Zykov et al., 2005). The same may apply to AI, where a self-replication mechanism can serve as the last resort for detecting damage, or returning a damaged or out-of-control AI system back to normal.
- romaniv 9y ago
  >Biological life began with the first self-replicator I never understood why people assume that those biological self-replicators were in any way analogous to quines. Quines generate information from within themselves. Proto-life would have to assemble copies of itself from molecules available in the environment. It seems like completely different principles of work.
  - jachee 9y ago
burkaman 9y ago
1. It's cool. 2. "We suggest that a self-replication mechanism for artificial intelligence is useful because it introduces the possibility of continual improvement through natural selection."
visarga 9y ago
> What’s the significance of this paper? We're progressing from static neural nets (like the old TensorFlow) to dynamic nets (like PyTorch) and even dynamically generated on-the-fly neural nets (hypernets) which is great for creating architectures that better fit the problem, case by case. This paper shows another way to generate a net from a net, but this time with self replication. Self replication could be useful for evolutionary optimisation, and, as they say in the paper, could become a rudimentary form of introspection. The idea of a "self-replication loss term" is very exciting, it's rare that we see such innovation in loss functions.

Quine, the descriptor in the actual article, is both more accurate, and more appropriate for a forum made of programmers. The fact that they made it into a quine with non-trivial, useful side effects is actually really interesting, regardless of the language/paradigm.

deleted 9y ago

[deleted]

_0ffh 9y ago

Isn't this essentially looking for a fixpoint?

vanderZwan 9y ago
> In mathematics, a fixed point (sometimes shortened to fixpoint, also known as an invariant point) of a function is an element of the function's domain that is mapped to itself by the function. https://en.wikipedia.org/wiki/Fixed_point_(mathematics) https://en.wikipedia.org/wiki/Fixed_point_(mathematics) Looks like it. And they need to resort to some mathematical trickery to achieve this because as the explain in the paper: > A neural network is parametrized by a set of parameters Θ, and our goal is to build a network that outputs Θ itself. This is difficult to do directly. Suppose the last layer of a feed-forward network has A inputs and B outputs. Already, the size of the weight matrix in a linear transformation is the product AB which is greater than B for any A > 1.

popcorncolonel 9y ago

So genetic programming, but for NN's? Hasn't that been done?

qiemem 9y ago
GP for NNs has, but this isn't GP; "self-reproduction" (as in the original title) here means that the neural network is learning to output a copy of itself. In other words, the NN is learning to be a quine (as indicated by the current title). This is a very different than just applying genetic programming to NNs. In GP, you're updating the NN (or whatever) by copying it with mutations/recombinations. Here, the NN itself is learning to create a copy of itself. The fact that they manage to also train to the network to simultaneously perform somewhat complicated tasks is super crazy.

std_throwaway 9y ago

This is a tautology.