3 ms·
The answers can be recorded and reviewed. The other points are true, or is there a way to make outcomes deterministic, when compared to previous versions while
by lo0dot0 1y ago
The answers can be recorded and reviewed. The other points are true, or is there a way to make outcomes deterministic, when compared to previous versions while allowing to add more knowledge in newer versions?
- vintermann 1y agoIt's possible to make any model deterministic. Used to be just to save the seed, but I'm not sure it still is now that everything is distributed. Maybe a little more effort.
- lo0dot0 1y agoA part of my question that you didn't go into was, can new knowledge be added in a new version without making the answers with knowledge learned in previous versions non-deterministic?
- dijksterhuis 1y agothat’s not really how training works. changing the input (data) means you get a different output (model). source data has nothing to do with model determinism. as an end-user of AI products, your perspective might be that the models are non-deterministic, but really it’s just different models returning different results … because they are different models. “end-user non-determinism” is only really solved by repeatedly using the same version of a trained model (like a normal software dependency), potentially needing a bunch of work to upgrade the (model) dependency version later on.
- dustingetz 1y agodeterminism isn’t really enough, we want “predictable”. Most of these AI wavefunctions are “chaotic” - tiny changes in state can cause wildly divergent outcomes
- Yoric 1y agoBut that won't survive an upgrade, will it?
- kevingadd 1y agoThis requires an exact lock-down of things like the hardware and driver version, doesn't it? Is that sustainable?
- vintermann 1y agoIt shouldn't. It didn't used to, at least.