3 ms·
Yes, but the whole point of the link submitted to HN here is that in some applications, like machine learning, precision doesn't matter too much. (However, ana
by eru 3y ago
Yes, but the whole point of the link submitted to HN here is that in some applications, like machine learning, precision doesn't matter too much.
(However, analog computing is still a bad fit for machine learning, because it requires a lot more power.)
- the8472 3y agoExact copies aren't just about precision but also about reproducibility.
- eru 3y agoYou can keep your weights in a discrete format for storage, but do inference and training in analog.
- the8472 3y agoThat only prevents analog copy degradation. It doesn't give you reproducibility. Reproducibility means running the same process twice with the same inputs and getting the same outputs. E.g. to later prove that something came from an LLM and not a human you could store the random seed and the input and then reproduce the output. But that only works if the network is digital.