4 ms·
> This not only replaces human labor but enables entirely new types of endeavors. I completely agree with that! I think we are talking past each other a bit, b
by myrmidon 2y ago
> This not only replaces human labor but enables entirely new types of endeavors.
I completely agree with that! I think we are talking past each other a bit, because to me all your examples seem supportive of my main point: None of those revolutions in tech really made their inventors "break capitalism", but instead the "commodity providers" of the digital age made good business together with all the new industry that sprouted up and used the tech...
> Its virtually certain that an AGI could run on average consumer hardware.
Sure. But then what? I can totally see you getting the equivalent of 10 human white-collars for a kilowatt within a decade or two. (Sidenote: I don't believe we'll ever get past the 0.1W/human-equivalent brain in efficiency, and even that is an optimistic estimate that I would not stake anything on).
You might be able to further improve those systems, getting up to a hundred or even a thousand clever humans-- a veritable army of consultants/contractors at everyones fingertips.
And thats great! But an army of consultants for almost free is NOT a singularity-- it is extremely doubtful to me that you are even gonna get "the sum of its parts" out of such an arrangement; expecting such a construct to be capable of rapid self improvement is extremely optimistic (just compare real-life armies of consultants, which are typically agreed to be not capable of rapid self improvement, even if you throw exponentially increasing amounts of them at it).
Just like real life armies of consultants, we will have to be careful that the work is actually aligned with our interests though, and having many more consultants than actual people is dangerous business already...