4 ms·

So you may like better, > “Multiple simultaneous optimizers” search for a (local) maximum value of some function E(λ1, …, λn) of several parameters. Each unit

So you may like better, > “Multiple simultaneous optimizers” search for a (local) maximum value of some function E(λ1, …, λn) of several parameters. Each unit Ui independently “jitters” its parameter λ1, perhaps randomly, by adding a variation δi(t) to a current mean value μi. The changes in the quantities λi and E are correlated, and the result is used to slowly change μi. The filters are to remove DC components. This technique, a form of coherent detection, usually has an advantage over methods dealing separately and sequentially with each parameter. (In “Steps”) :-)

riku_iki 4y ago
can you provide link, and what conclusions you derived from this text if your interest is meaningful discussion?
- masswerk 4y ago
  The link has been already provided above (opus cit), it's directly connected to the very question of gradients, providing a specific implementation (it even comes with a circuit diagram). As you were claiming a lack of detail (but apparently not honoring the provided citation)… (The earlier you go back in the papers, the more specifics you will find.)
  - riku_iki 4y ago
    You didn't give me any links. And what are your conclusion from citation? You are claiming again that Minsky invented gradient descent?
    - masswerk 4y ago
      For the link and claims, see the the very comment you initially answered to.
      - riku_iki 4y ago
        That claim was answered: Minsky didn't invent gradient descent.
        masswerk 4y ago
        That claim was never made, but by you. The claim was, Minsky had practical experience and wrote about experiences with gradient descend (aka "hill climbing") and problems of locality in a paper published Jan. 1961. On the other hand: who invented "hill climbing"? You've contributed nothing to the question, you've posed (which was never mine, nor even an implicit part of any claims made).
        riku_iki 4y ago
        Ok, Minsky "pioneering" is his writing about something invented before him. Anything else? :)
        masswerk 4y ago
        Well, who wrote before 1952 about learning networks? I'm not aware that this would have been already main stream, then. (Rosenblatt's first publication on the Perceptron is from 1957.) It would be nice, if you contributed anything to the questions you are posing, like, who invented gradient descent / hill climbing or who can be attributed for this? what substantial work precedes the writings of Minsky on their respective subject matter (substantially)? why was this already mainstream or how and where were these experiments already conducted elsewhere (as in "not pioneering")? Where is the prior art to SNARC?
        riku_iki 4y ago
        > Well, who wrote before 1952 about learning networks? steps which you referred not from 1952. > Where is the prior art to SNARC? We don't know what was the SNARC so can't say if there was prior art. Any other fantasies? :-)

riku_iki 4y ago

can you provide link, and what conclusions you derived from this text if your interest is meaningful discussion?

masswerk 4y ago
The link has been already provided above (opus cit), it's directly connected to the very question of gradients, providing a specific implementation (it even comes with a circuit diagram). As you were claiming a lack of detail (but apparently not honoring the provided citation)… (The earlier you go back in the papers, the more specifics you will find.)
- riku_iki 4y ago
  You didn't give me any links. And what are your conclusion from citation? You are claiming again that Minsky invented gradient descent?
  - masswerk 4y ago
    For the link and claims, see the the very comment you initially answered to.
    - riku_iki 4y ago
      That claim was answered: Minsky didn't invent gradient descent.
      - masswerk 4y ago
        That claim was never made, but by you. The claim was, Minsky had practical experience and wrote about experiences with gradient descend (aka "hill climbing") and problems of locality in a paper published Jan. 1961. On the other hand: who invented "hill climbing"? You've contributed nothing to the question, you've posed (which was never mine, nor even an implicit part of any claims made).
        riku_iki 4y ago
        Ok, Minsky "pioneering" is his writing about something invented before him. Anything else? :)
        masswerk 4y ago
        Well, who wrote before 1952 about learning networks? I'm not aware that this would have been already main stream, then. (Rosenblatt's first publication on the Perceptron is from 1957.) It would be nice, if you contributed anything to the questions you are posing, like, who invented gradient descent / hill climbing or who can be attributed for this? what substantial work precedes the writings of Minsky on their respective subject matter (substantially)? why was this already mainstream or how and where were these experiments already conducted elsewhere (as in "not pioneering")? Where is the prior art to SNARC?
        riku_iki 4y ago
        > Well, who wrote before 1952 about learning networks? steps which you referred not from 1952. > Where is the prior art to SNARC? We don't know what was the SNARC so can't say if there was prior art. Any other fantasies? :-)