3 ms·
Bits are copyable without data loss. Analog properties of individual transistors are less so.
by the8472 3y ago
Bits are copyable without data loss. Analog properties of individual transistors are less so.
- eru 3y agoYes, but the whole point of the link submitted to HN here is that in some applications, like machine learning, precision doesn't matter too much. (However, analog computing is still a bad fit for machine learning, because it requires a lot more power.)
- the8472 3y agoExact copies aren't just about precision but also about reproducibility.
- eru 3y agoYou can keep your weights in a discrete format for storage, but do inference and training in analog.
- the8472 3y agoThat only prevents analog copy degradation. It doesn't give you reproducibility. Reproducibility means running the same process twice with the same inputs and getting the same outputs. E.g. to later prove that something came from an LLM and not a human you could store the random seed and the input and then reproduce the output. But that only works if the network is digital.