3 ms·
> > We can still regulate the new ai tools, but we must act quickly. Whereas nukes cannot invent more powerful nukes, ai can make exponentially more powerful ai
by AnimalMuppet 4y ago
> > We can still regulate the new ai tools, but we must act quickly. Whereas nukes cannot invent more powerful nukes, ai can make exponentially more powerful ai.
> I mean, maybe. Sure, LLMs can currently code shockingly well, and LLMs are just programs, so an LLM writing an LLM is def much more likely than a nuke building a nuke. But we don't _know_ if there are limits to what AIs can do. Or, to pick on the word "exponential," we don't know if there are limits to growth rates of AIs improving AIs!
It seems to me that the current approach to AIs can improve along only two axes: better training data, or better algorithms. I don't think this kind of AI can generate better training data for the next generation of itself, just by the nature of how it operates. It (currently) doesn't know truth from falsehood; how is it going to know what training data is better or worse than other data? And I don't think it can improve its algorithm either. It may be able to implement an algorithm that someone else specifies, but I'm not sure that it can write a working algorithm, let alone an improved working algorithm.
So I don't think that self-improving AI is currently on the table.