3 ms·
The specific instance doesn’t need to know everything happening in the world at once to be AGI though. You could feed the trained model different contexts based
by echoangle 1y ago
The specific instance doesn’t need to know everything happening in the world at once to be AGI though. You could feed the trained model different contexts based on the task (and even let the model tell you what kind of raw data it wants) and it could still hypothetically be smarter than a human.
I’m not saying this is a realistic or efficient method to create AGI, but I think the argument „Model is static once trained -> model can’t be AGI“ is fallacious.
- godelski 1y agoI think that makes a lot of assumptions about the size of data and what can be efficiently packed into prompts. Even if we're assuming all info in a prompt is equal while in context and that it compresses information into the prompts before it falls out of context, then you're going to run into the compounding effects pretty quickly. You're right, you don't technically need infinite, but we are still talking about exponential growth and I don't think that effectively changes anything.