3 ms·
> And this will not just be in government, it will be everywhere. The scariest part is that as people start to spend less time developing a skill set, and inste
by ben_w 3y ago
> And this will not just be in government, it will be everywhere. The scariest part is that as people start to spend less time developing a skill set, and instead deferring to AI answers, you will cross a point where this problem can't be fixed (because nobody has the skills to fix it and the AI is trained on the outputs of previous generations of humans).
I think that would require AI development to approximately halt at close to the current level for over a lifetime.
Conditional on development halting, I'd agree with you. By analogy, there's this single, very useful, very powerful, set of "hidden methods that can be used to win all games, get rich, find love, determine the limits of thought itself!" — mathematics[0]. Do people like learning it? They do not. Calculator much easier. What a calculator does is none of that, calculators are merely arithmetic, but most people can't tell the difference between mathematics and arithmetic.
I think LLMs have the same effect on anything that can be expressed in words, and all the various image generator models have this effect on graphical arts. One must be extremely motivated to get past the "but the computer is better than me" hump.
However, I don't expect AI development to even approximately halt at anything close to the current level. There's a lot of room for self-play in domains like maths and computing where the proofs can be verified, and probably a lot of room for anything that can be RLHF'd, too. And that's also assuming we don't get any brain uploads; regardless of the question of "is such an upload of a human capable of consciousness", which absolutely matters, it may still be relevant to the economic issues of AI depending on the cost of running one depending on all the details of such an upload that I can't even begin to guess at at this point (last I heard, https://openworm.org https://openworm.org was not actually measuring synaptic weights directly, but rather neural activity? I may be out of date, not my field).
Whatever happens, however good it does or doesn't get, I do expect something to go very weird before I reach the current state pension age — close enough that, if that something is "the machines break" or "society breaks", then there will still be plenty who remember the before times.
[0] https://www.smbc-comics.com/comic/secrets-2 https://www.smbc-comics.com/comic/secrets-2
- rglover 3y ago> I think that would require AI development to approximately halt at close to the current level for over a lifetime. What I'm getting at isn't AI development halting, but human knowledge/creativity halting [1]. Because the AI is and can only be trained on human knowledge, it's knowledge of reality has an upper bound (whereas, theoretically, humans can know anything or make new discoveries that don't exist in our current knowledge set). If you don't tell the AI that strawberries are a thing/reality, it will never conceive of a strawberry on its own. And arguably, it's not fair to call these things "AI" until they can do so. [1] Charlie Munger said "show me the incentives and I'll show you the outcome." Well, in this case, the incentives to use AI > spending the time to learn and develop skills. The outcome here is clear: humans will stop producing new knowledge and by extension, the AI will stop receiving new knowledge to learn.
- ben_w 3y ago> Because the AI is and can only be trained on human knowledge, it's knowledge of reality has an upper bound (whereas, theoretically, humans can know anything or make new discoveries that don't exist in our current knowledge set). AI do not have such a limitation; they can be trained on anything, including to design and then perform their own experiments in laboratories, e.g. this one: https://engineering.cmu.edu/news-events/news/2023/12/20-ai-coscientist.html https://engineering.cmu.edu/news-events/news/2023/12/20-ai-c... > If you don't tell the AI that strawberries are a thing/reality, it will never conceive of a strawberry on its own. And arguably, it's not fair to call these things "AI" until they can do so. I have far too many projects on my plate right now, but that is kinda one of them, has been since… wow, only December, these last few months have felt like years: https://benwheatley.github.io/blog/2023/12/12.html https://benwheatley.github.io/blog/2023/12/12.html