3 ms·
Yeah, analog memory fits so incredibly well. Who cares if it's not "exact" and fuzzes around a bit if it's only used for weights and has massive efficiency adva
by anyfoo 1y ago
Yeah, analog memory fits so incredibly well. Who cares if it's not "exact" and fuzzes around a bit if it's only used for weights and has massive efficiency advantages. Weights are never "exact" themselves, and it doesn't matter if they don't always read exactly the same. You basically just get some extra "temperature" for free!
A bit beautiful that we might end up partially going back to analog computers, which were quickly replaced by digital ones.
- magicalhippo 1y ago> A bit beautiful that we might end up partially going back to analog computers, which were quickly replaced by digital ones. How long till we get a Ben Eater-style video about someone making a basic analog neural network using some DACs, analog multipliers[1] and bucket-brigade chips[2] for intermediate values? [1]: https://www.analog.com/media/en/training-seminars/tutorials/MT-079.pdf https://www.analog.com/media/en/training-seminars/tutorials/... [2]: https://en.wikipedia.org/wiki/Bucket-brigade_device https://en.wikipedia.org/wiki/Bucket-brigade_device