Honestly the whole fear mongering around AGI is kind of annoying. We are very far away from AGI, and its driving focus away from the main issues that people sh

Honestly the whole fear mongering around AGI is kind of annoying. We are very far away from AGI, and its driving focus away from the main issues that people should be paying attention to. An AGI, by definition, can start with zero information, and learn on its own. Where are the models for that? The closest thing we have is Mu Zero, but we have to give it an objective function, which destroys the whole idea of AGI in the first place (as it should be able to generate its own objective functions) and it takes a shitload of resources to run for a very limited rule set. Until you have something like this in place, no version of Chat GPT will even come close to AGI. The problems that chat GPTs are solving are turning out to be not as complex as we thought, thats all that the "sparks of AGI" are. What will happen assuming the current course of iteration on the models is that humanity will get is essentially better and better software that can solve a large range of complex problems. You will have essentially a large body of human knowledge that is compressed in some form, with the ability to interpolate between branches very efficiently. This will create issues because you will now be able to ask multi modal questions like "what do I need to do economically to ensure ultimate compliance of the population?", and the solution will involve things like which government offices to target with what information, generated videos of propaganda, special products that promote addition or some other health changes, e.t.c. To prepare against this, the solution isn't to lock down the models and hide the key while telling everyone how AGI is going to kill us all, the solution is to allow everyone access to this and let the AIs fight against each other and reach an equilibrium.