3 ms·
> Has an AI already been used to improve itself, or create another AI? To the extent OSS community uses GPT-3 and GPT-4 to generate training data for training
by TeMPOraL 3y ago
> Has an AI already been used to improve itself, or create another AI?
To the extent OSS community uses GPT-3 and GPT-4 to generate training data for training open models, AI is indeed being used to improve itself.
Runaway self-improving AI doesn't need to be - and is, initially, unlikely to be - a single instance of a model improving itself at runtime. AI models being used to directly or indirectly increase capabilities of other AI models fits the bill too.
- bsder 3y agoEver see what happens when you compress an image over and over?
- TeMPOraL 3y agoYes. But I'm not talking about looping on that in particular. GPT-sourced data is just fine if you're trying to cheaply bootstrap LLM of a different family/architecture that is meant to compete with GPT, and need something to cover for training data you can't otherwise afford to get. It's a one-time deal, but ten GP was askind: > Has an AI already been used to improve itself, or create another AI? And IMO this fits the bill.