4 ms·

The fact that models aren't continually updating seems more like a feature. I want to know the model is exactly the same as it was the last time I used it. Any

by 10xDev 7mo ago

The fact that models aren't continually updating seems more like a feature. I want to know the model is exactly the same as it was the last time I used it. Any new information it needs can be stored in its context window or stored in a file to read the next it needs to access it.

kergonath 7mo ago
> The fact that models aren't continually updating seems more like a feature. I think this is true to some extent: we like our tools to be predictable. But we’ve already made one jump by going from deterministic programs to stochastic models. I am sure the moment a self-evolutive AI shows up that clears the "useful enough" threshold we’ll make that jump as well.
- 10xDev 7mo ago
  Stochastic and unpredictability aren't exactly the same. I would claim current LLMs are generally predictable even if it is not as predictable as a deterministic program.
  - kergonath 7mo ago
    No, but my point is that to some extent we value determinism. By making the jump to stochastic models we already move away from the status quo; further jumps are entirely possible. Depending on use case we can accept more uncertainty if it comes with benefits. I also don’t think there is a reason to believe that self-learning models must be unpredictable.
jnd-cz 7mo ago
Unless you use your oen local models then you don't even know when OpenAI or Anthropic tweaked the model less or more. One week it's a version x, next week it's a version y. Just like your operating system is continuously evolving with smaller patches of specific apps to whole new kernel version and new OS release.
- 10xDev 7mo ago
  There is still a huge gap between a model continuously updating itself and weekly patches by a specialist team. The former would make things unpredictable.
lxgr 7mo ago
Persistent memory through text in the context window is a hack/workaround. And generally: > I want to know the model is exactly the same as it was the last time I used it. What exactly does that gain you, when the overall behavior is still stochastic? But still, if it's important to you, you can get the same behavior by taking a model snapshot once we crack continuous learning.
edgyquant 7mo ago
It’s a feature of a good tool, but a sentient intelligence is more than just a tool

by 10xDev 7mo ago

kergonath 7mo ago

> The fact that models aren't continually updating seems more like a feature. I think this is true to some extent: we like our tools to be predictable. But we’ve already made one jump by going from deterministic programs to stochastic models. I am sure the moment a self-evolutive AI shows up that clears the "useful enough" threshold we’ll make that jump as well.

10xDev 7mo ago
Stochastic and unpredictability aren't exactly the same. I would claim current LLMs are generally predictable even if it is not as predictable as a deterministic program.
- kergonath 7mo ago
  No, but my point is that to some extent we value determinism. By making the jump to stochastic models we already move away from the status quo; further jumps are entirely possible. Depending on use case we can accept more uncertainty if it comes with benefits. I also don’t think there is a reason to believe that self-learning models must be unpredictable.

jnd-cz 7mo ago

Unless you use your oen local models then you don't even know when OpenAI or Anthropic tweaked the model less or more. One week it's a version x, next week it's a version y. Just like your operating system is continuously evolving with smaller patches of specific apps to whole new kernel version and new OS release.

10xDev 7mo ago
There is still a huge gap between a model continuously updating itself and weekly patches by a specialist team. The former would make things unpredictable.

lxgr 7mo ago

Persistent memory through text in the context window is a hack/workaround. And generally: > I want to know the model is exactly the same as it was the last time I used it. What exactly does that gain you, when the overall behavior is still stochastic? But still, if it's important to you, you can get the same behavior by taking a model snapshot once we crack continuous learning.

edgyquant 7mo ago

It’s a feature of a good tool, but a sentient intelligence is more than just a tool