3 ms·
>supposition that weights must change The thing is that's where most of the leaning and 'intelligence' is. If you don't change them the model doesn't really ge
by tim333 8mo ago
>supposition that weights must change
The thing is that's where most of the leaning and 'intelligence' is. If you don't change them the model doesn't really get smarter.
- jvanderbot 8mo ago> The thing is that's where most of the leaning and 'intelligence' is The question is: Is it required for AGI that the model changes its weights _during deployment_, or can we train up and deploy like we do now and manage learning via context? Taken to extreme, "context" could be defined as the "change in weights from training time" so the answer is trivially "yes", but that seems like cheating.