4 ms·
AGI to me is reached once the intelligence is self motivated, i.e. it doesn't rely on us prompting it into action. I don't see how LLMs will ever get to that st
by dom96 28d ago
AGI to me is reached once the intelligence is self motivated, i.e. it doesn't rely on us prompting it into action. I don't see how LLMs will ever get to that stage.
- drittich 28d agoOften the smartest thing is to do nothing.
- phatfish 28d agoOr know when to shut up. A tangent, but can anyone ELI5 how models "know" when to stop generating tokens? Or what the method to stop them at the right point is?
- bigfudge 28d agoI might be out of date but my understanding was that STOP was just another token that gets predicted.
- bulder 28d agoThe model doesn't "know" how to generate tokens any more than it knows how to stop generating tokens. The sampler simply stops pulling values when it outputs a "stop token", which is a token the same way every other token is. That is to say, it stops when it's statistically the most likely to.
- phatfish 28d agoOK thanks, so the neural net (that no one can explain fully) generates a "stop" signal at a certain point.
- dlubarov 28d agoWouldn't agents that do inference in an infinite loop pass that bar?
- ilaksh 28d agoI agree that LLMs are unlikely to be the final form for AGI, but what you are talking about is orthogonal to the IQ and for most cases general utility. It's like looking at a savant chained to a workstation reading tasks from a conveyor belt and saying that it will never have human level capabilities.