3 ms·
> non-deterministic artificial intelligence Is it really non-deterministic, or is that just a misinterpretation of the opacity in deep learning algorithms? If
by arijun 2y ago
> non-deterministic artificial intelligence
Is it really non-deterministic, or is that just a misinterpretation of the opacity in deep learning algorithms? If the word choice isn’t a mistake, I wonder what the non-determinism adds.
- melony 2y agoSigh it means in their neural network layer they have a random sampling step. Yay for Gaussians.
- hiddencost 2y agoIDK, it could mean it's not if/else structured computer code. The idea that you can't guarantee consistent results under small variation is a big deal to non technical people who are buying ML applications
- nradov 2y agoPossibly both? Modern AI models often include a "temperature" parameter which produces a certain level of randomness in the output. But the inner models are also opaque in a way that makes it impossible for humans to reason about them, so the output may appear non-deterministic for all practical purposes even if it is technically deterministic in a purely mathematical sense.