3 ms·
>> To train the system with a minimal amount of computing and memory, the researchers actually built two identical networks on top of each other. In the “clampe
by phkahler 5y ago
>> To train the system with a minimal amount of computing and memory, the researchers actually built two identical networks on top of each other. In the “clamped” network, they fed in the input voltages and fixed the output voltage to the value they wanted. In the “free” network, they fixed just the input voltage and then let all the other voltages float to whatever value they would, which generally gave the wrong voltage at the output.
>> The system then adjusted resistances in the two networks according to a simple rule that depended on whether the voltage difference across a resistor in the clamped network was bigger or smaller than the voltage difference across the corresponding resistor in the free network. After several iterations, those adjustments brought all voltages at all the nodes in the two networks into agreement and trained both networks to give the right output for a given input.
How is this not just a perceptron? I'm also curious about the rule for adjusting resistances in both networks.
- L_226 5y agoIt is a perceptron, just implemented in actual hardware. The Veritasium YT channel recently did a piece on analogue computers [0]. I didn't find his explanation too compelling, but it is still a good video. [0] - https://www.veritasium.com/videos/2021/12/21/the-most-powerful-computers-youve-never-heard-of https://www.veritasium.com/videos/2021/12/21/the-most-powerf...
- supercheetah 5y agoAna does a better job I think of explaining some of the finer details, and some specific implementations[1]. 1. https://youtu.be/67LXWocO9HI https://youtu.be/67LXWocO9HI
- mywittyname 5y agoIt sounds specifically like a linear adaptive filter.
- selimthegrim 5y agoCan you elaborate? Is there a windowing function at all?
- edgyquant 5y agoI believe they are arguing semantics. I would definitely consider two networks moving bits back and forth “computation”