3 ms·
> The fact that models aren't continually updating seems more like a feature. I think this is true to some extent: we like our tools to be predictable. But we’
by kergonath 8mo ago
> The fact that models aren't continually updating seems more like a feature.
I think this is true to some extent: we like our tools to be predictable. But we’ve already made one jump by going from deterministic programs to stochastic models. I am sure the moment a self-evolutive AI shows up that clears the "useful enough" threshold we’ll make that jump as well.
- 10xDev 8mo agoStochastic and unpredictability aren't exactly the same. I would claim current LLMs are generally predictable even if it is not as predictable as a deterministic program.
- kergonath 8mo agoNo, but my point is that to some extent we value determinism. By making the jump to stochastic models we already move away from the status quo; further jumps are entirely possible. Depending on use case we can accept more uncertainty if it comes with benefits. I also don’t think there is a reason to believe that self-learning models must be unpredictable.