9 ms·

On being wrong about AI

63 points by nsoonhui 3y ago

Zetobal 3y ago
If he was as opinionated and aggressive in the podcast as he is in this writing he has to live with it.
blueflow 3y ago
> civilization-altering trajectory On which planet? Because i don't see any of it. AI should have made my console monkey job obsolete, by yesterday.
- bayindirh 3y ago
  Don't forget that many of us normalized scraping others' work, getting rid of the license, generating stuff based on these works and labeling them originals or "new", thinking that generative models are pulling these things out of thin air. Also, same people learnt to get angry on anyone who points out that there's most probably a license violation happened during the process, and these angry people believe that everything is fair use (if you're powerful enough).
- its-summertime 3y ago
  Is it impacting hiring decisions? Changes in government policy? etc. If not already, how about in the next 5 years? A majority of the use-cases are not going to be publicly attributed to AI, that however does not mean it isn't having an effect.
  - rsynnott 3y ago
    > Is it impacting hiring decisions? I mean, probably, sure, for some (generally poorly run) companies, but, when it comes to it, all 15 of the last two recessions have impacted hiring decisions. Companies, and particularly poorly-run companies, jump at shadows all the time.
    - TheOtherHobbes 3y ago
      It's not as if those recessions were partly the result of quant software making poor decisions.
      - rsynnott 3y ago
        My point is that a surprising number of hiring/layoff decisions are essentially made based on recessions which _never actually happen_. Possibly the most spectacular in recent years was in early 2020, when a bunch of tech companies laid off their recruitment staff in prep for the recession which was surely coming... That didn't generally work out well for them.
  - Jensson 3y ago
    Most of the current effects are due to AI hype, not due to AI itself. Regulations are trying to get ahead of AI, the reason it tries that is due to AI hype. Same with unions fighting against AI etc. Maybe that hype turns true, but if all AI development plateaued today and no new improvements were made to it then that AI's impact on the world would be very minimal. A useful tool for professionals, but not much more than that.
  - altdataseller 3y ago
    Technology that isn’t as advanced as AI is already impacting hiring decisions. When you submit your resume, most ATS systems rank you by a score
  - aleph_minus_one 3y ago
    > Is it impacting hiring decisions? [...] If not already, how about in the next 5 years? At least in the field of activity that I work in: No. I honestly don't have the slightest idea how AI could be really helpful for hiring decisions. The only "useful" usage of AI in hiring is to serve as a scapegoat for covering your a... if the hiring decision turned out to be a bad idea ("but the AI said ...").
SynasterBeiter 3y ago
[flagged]
OJFord 3y ago
This just seems silly to bother to defend? I followed the link to 'ridiculed on Twitter' expecting it to be horrible, 'oh yeah well I guess if you feel that personally attacked of course you'll think you have to do something'.. but it's not really? It's just someone pointing it out and yeah it's kind of funny in hindsight? Have a laugh and move on?
pharmakom 3y ago
The latest LLMs are remarkable, but I think the AI Doomer claims are still a reach. My prediction is that the current AI boom will fizzle out into a handful of useful products and a lot of smoke from VC cash. Where are the moon bases? Supersonic jets? Asteroid mines? Self driving cars? We’ve gotten over excited so many times in the past.
- FeepingCreature 3y ago
  To be fair, none of those are ultimately a matter of "can't" so much as "don't really want to." When we got a billionaire who wanted serious space colonization, we got SpaceX, which is currently working on a moon lander that qualifies as a base in its own right. And of course, we had supersonic jets, there just wasn't enough demand. People want cheap flights more than super-fast flights. We often get excited about these things, but society usually doesn't. That may be one way in which the current AI boom is different.
  - BigJono 3y ago
    Or it might be one way in which it's exactly the same.
    - FeepingCreature 3y ago
      I think you're underestimating the hype potential of "it's an app that I can have a normal conversation with."
- bayindirh 3y ago
  They take too long to build and require that thing called engineering which requires blood sweat and tears. On the other hand, you can scrape the internet, build a model, semi-rig a couple of demos, hype the product and earn money. Don't forget, it's all about money. Product is just a means to get money. Building good things and earning good money as a byproduct is a thing of the old. Boomer stuff. Modern people don't do that anymore. It's not efficient, capitalist and quick enough.
aleph_minus_one 3y ago
"For that matter, hardly anyone predicted the staggering, civilization-altering trajectory of neural network performance from roughly 2012 onwards." Whether the trajectory will be civilization-altering is yet to be seen. Let me put it this way: I have serious doubts.
- viraptor 3y ago
  It's already been common-behaviour altering in many ways. I'm not sure if it counts as civilisation altering, but the way we create art, get creative review, find and consume large documents have suddenly changed. Not for the majority yet, but it's only a matter of time. For the first time we can get a knowledgeable ad-hoc assistant anywhere, immediately. Even if it's been bad in many ways, it's improving almost every day.
  - orwin 3y ago
    > the way we create art, get creative review, find and consume large documents have suddenly changed. I disagree for your first two points. I do use generative AI to create image for my SWADE/DnD campaigns, but this is not art, this is illustration. There is no story behind the style, there is no story behind the color choice, or the meaning of the portraits. AI was able to imitate Art since at least imagemagik. Kazimir Malevich's art, at least. Music is the same. Unless you think a DJ mixing up without mods or adding anything is an artist, in this case you might consider AI music art. I consider it entertainment. Never got anything creative from ChatGPT, even when i was paying for it. Bing chat (and copilot) is great to replace google, scaffold a lot of my code, and definitely boosted my productivity somewhat. But there's a reason why i don't use it to write my scenarii (still use it to spellcheck and syntax check), and even dialogs i have given up on (faster to prepare it myself in the end).
- kashyapc 3y ago
  Yeah; it is absurd hyperbole. The only person I've seen talk sensible on these topics is Stuart Russell of "Human Compatible" (read the book, it's written with great clarity). He has his head firmly on his shoulders and eschews the breathless hype.
Jensson 3y ago
> He seems to have thought someone was going to discover a revolutionary “key” to AI. That didn’t happen; you might say I was right to be skeptical of it. Transformer architecture happened, that is key for neural networks to build up context dependent reasoning, we wouldn't have gotten to where we are today without it. Without it scaling neural networks doesn't add much value, since without being able to separate out contexts they fail to develop a large amount of separate skills within the same model. So yes, a very important key was found, it wasn't just scaling that got us here.
- treprinum 3y ago
  Transformers are synonymous with scaling as it was the first model that kept improving both by adding more and more layers and throwing more training data at it. All the previous models like CNNs, ResNet, LSTMs etc. hit some depth/training size where no progress was happening anymore as gradient was unreliably flowing down.
surprisetalk 3y ago
Yudkowsky is obviously extremely smart, but something about his approach causes me to put up psychic walls against everything he says. To see Aaronson say things like "2%" from within the walls of OpenAI is beyond sobering.
mark_l_watson 3y ago
Scott shouldn’t be hard on himself at all for opinions stated 15 years ago. Even over short time spans of a few years, I change my perspective quite a bit. In the 1980s I was lucky enough to stumble into the opportunity of serving on a DARPA neural networks tools panel for a year and getting lucky applying a simple backprop model to a show-stopper problem for a bomb detector my company designed and built for the FAA. Bonus time! Decades went by, and then deep learning really changed my view of AI and technology (I managed a deep learning team at Capital One, and it was a thrill to see DL applications there). Now I am witnessing the same sort of transformations driven by attention based LLMs. It is interesting how differently people now view pros/cons/dangers/this-shit-will-save-the-world possibilities of AI. Short anecdote: last week my wife and I had friends for dinner. Our friends, a husband and wife team who have decades of success writing and producing content for movies and now streaming. I gave them a fairly deep demo of what ChatGPT Pro could do for fleshing out story ideas, generating images for movie posters and other content, etc. The husband was thrilled at the possibility of now being able to produce some of his previously tabled projects inexpensively. His wife had the opposite view, that this would cause many Hollywood jobs to be lost, and other valid worries. Normally our friends seem aligned in their views, but not in this instance.
- 9991 3y ago
  Your take is that you’re wrong a lot, so it’s OK others to be wrong? If the stakes are high, we should be learning how to not make mistakes rather than how to make excuses after the fact.
  - mark_l_watson 3y ago
    I think you misunderstood what I was saying, so I will try to be more clear: I was describing myself as an observer and participant in different waves of AI tech. I was not admitting to being wrong, rather, just someone who was lucky enough to be a small part of AI. What I don’t know right now: if AI will help solve difficult societal/energy/medical/scientific problems and propel humanity into a better future (I bet on this outcome) or that the AI-doomers are correct (not my view). I try to absorb the AI dangers arguments and keep an open mind. Good resources: https://podcasts.apple.com/us/podcast/your-undivided-attention/id1460030305 https://podcasts.apple.com/us/podcast/your-undivided-attenti... and I also think that privacy advocates (see books Surveillance Capitalism, and Privacy is Power) are useful in deciding what we should and shouldn’t do with AI.
fidotron 3y ago
It has become clear that the defining route to riches this century is to persuade the already powerful of a huge threat to the status quo, then claim that you offer the way to control it, and ideally turn it into a mechanism for further entrenching established interests. It may have always been this way and I am just getting old.
- anonymousDan 3y ago
  Finding ways to make rich people richer will always make solid business sense unfortunately.
  - Jensson 3y ago
    Making any group of people richer is good business sense as long as those riches doesn't come from you, since then you can take a share of that. That include unions taking a share of worker salaries in order to make those workers make a bigger salary.
MrScruff 3y ago
I think a lot of his defence here is "No-one could have known exactly what was going to happen and no-one knows what will happen next." This is obviously true - predicting the future is hard. It doesn't however explain giving a timeline of thousands of years, which is a ridiculously long time for anything you believe to be technically feasible.
samirillian 3y ago
I think he's just wrong about being wrong now. I'll believe it when AI invents a joke. I've still seen 0 creativity, it's just an aggregator.
sigmoid10 3y ago
This article is absolutely pointless. The statement was from 2009. Back then, neither side had any real evidence in favour of their argument. Deep learning and AI were still purely academic experiments, with zero practicality. And it had been like this for half a century. Back then, even the best models couldn't tell cats from dogs. Today every high schooler with a laptop can solve that problem thanks to abundant hardware and libraries. So both sides were just making up random numbers. This should be a lesson about people, despite their expertise, talking out of their ass instead of reminiscing famous quotes like "horses are better than cars." That statement is also funnily wrong in today's world, but at the time (i.e. without gas stations and roads and infrastructure everywhere), it too was rather reasonable.
- T-A 3y ago
  > This article is absolutely pointless. Not at all, but maybe you didn't read far enough to get to it. > The statement was from 2009. Back then, neither side had any real evidence in favour of their argument. Deep learning and AI were still purely academic experiments, with zero practicality. That's exactly what the article says: I was explaining that there was no trend you could knowably, reliably project into the future such that you’d end up with human-level AI. And in a sense, I was right. and then it explicitly states the point: The trouble, with hindsight, was that I placed the burden of proof only on those saying a dramatic change would happen, not on those saying it wouldn’t. Note that this is the exact same mistake most of the world made with COVID in early 2020. I would sum up the lesson thus: one must never use radical ignorance as an excuse to default, in practice, to the guess that everything will stay basically the same.
  - sigmoid10 3y ago
    >maybe you didn't read far enough to get to it. Perhaps you didn't read my comment far enough to get it. The point is - essentially - you can't trust experts in any field when they start arguing beliefs instead of science. It has nothing to do with confidence in technological pacing or lack thereof. It seems the author has learned nothing of his real mistake and would be prone to repeating it in the future.
- 3y ago
deleted 3y ago
[deleted]
its-summertime 3y ago
> Eliezer himself didn’t believe that staggering advances in AI were going to happen the way they did, by pure scaling of neural networks. I'd say its more than just scaling, only the smallest forms run on a modern phone, slowly, with caveats. Its far beyond anything reasonable. I still find it weird that there are probably multiple datacenters worth of compute just generating text.
- NoGravitas 3y ago
  Text, waste heat, and CO2 emissions.
_cjse 3y ago
I decided early on that wasting my one existence trying to solve a problem that seemed unsolvable wasn't what I wanted to do, especially given the stakes (it's very easy to reason yourself into working 14 hour days if you think it means saving the world is 0.001% more likely). However, I never found a satisfying argument against the default outcome being doom. The closest I ever came to a "solution" is to target the economic forces which lead to people researching and innovating on AI. I eventually found fine-based bounties to be an unusually potent weapon, not only here, but against all kinds of possible grey- and black-urn technologies. I wrote up my thoughts very briefly about a year ago, and they still live at [url-redacted], but I suspect the argument is fundamentally flawed in a way I as a non-academic don't have time to suss out. So I find myself in a strange place: Live my life mostly as normal, with a good chunk of my finances in low cost index funds, just in case the exponential starts shooting up - and just in case we don't all perish soon afterwards. C'est la vie.
deleted 3y ago
[deleted]
roenxi 3y ago
The major mistake - some people have been getting this right - is looking at algorithms rather than processing power. The people who were just following the exponential curves [0] pointed out that we'd be hitting human-brain levels of processing power some time around now. Turns out intelligence isn't complicated; it just needs a lot of brute force matrix math. This blog post can be interpreted as "I didn't realise what it was like living through an exponential process". Things happen very quickly. [0] https://spectrum.ieee.org/estimate-human-brain-30-times-faster-than-best-supercomputers https://spectrum.ieee.org/estimate-human-brain-30-times-fast...
deleted 3y ago
[deleted]
renegat0x0 3y ago
"""thereby ensuring that both camps would sneer at me equally.""" In modern polarized environment you have to be hot or cold. In this example you either have to be AI doomer, or not. Nuances are not allowed, you will be voted down by both sides of argument. People flock together in groups and sneer at one another with superiority.
Xcelerate 3y ago
> Eliezer himself didn’t believe that staggering advances in AI were going to happen the way they did, by pure scaling of neural networks. He seems to have thought someone was going to discover a revolutionary “key” to AI. That didn’t happen; you might say I was right to be skeptical of it. It’s interesting so many people in the field thought neural networks would not lead to AI. Back when I started working with them around 2013, I thought we’d have AGI by 2030 (which was an especially quacky view back then that has now become an only slightly quacky view), but I also believed there was absolutely no way neural networks would be the approach that got us there. They seemed like fancy regression or curve interpolators—good perhaps for approximating molecular energies in an efficient way but not capable of having a conversation with me. The “magic” that I thought neural networks were missing was algorithmic capability. Sure, they are universal function approximators, but that’s a bit of a hack theorem, and I didn’t think there was a realistic way to make use of that mathematical oddity; how could one practically train a neural network to compute a SHA256 hash? In fact, I still don’t think NNs can do that. But what I failed to realize, however, is that perhaps they could write the code to generate the hash. In retrospect, it seems kind of obvious, because of course the human brain can’t compute a hash function either—we just write code to do it as well. Computer programs today seem to fall into one of two categories: - “soft”: statistical learning or iterative linear algebra (NNs, SVMs, spectral methods, Monte Carlo, embeddings) - “hard”: rigid, algorithmic, discontinuous (cryptography, mathematical proof systems, discrete optimization) While most processes that occur in the human brain are probably characterizable as “soft”, I thought the uniqueness of human intelligence was due to a small but powerful amount of “hard” processing—and that we required a breakthrough in this area to achieve human-level AI. The release of GPT 3 immediately killed this viewpoint for me. That said, while I now believe we may be able to achieve AGI using “soft” computation alone, I still think that achieving optimal AGI will require extremely “hard”, algorithmic computation. Optimal AGI would be that which performs better than any other computable algorithm on a very general problem space given some reasonable objective function. It’s quite possible there are many different starting points (non-optimal AIs) for getting there—neural networks being one of them—but as these systems recursively improve themselves, my guess is that they all end up converging on one universal, algorithmic, optimal AGI.
orwin 3y ago
Just a small question about that: If we train a generative AI on AI text, is it becoming better, worst, or the same? Because if GenAI2, trained on GenAI1 production, is less useful or as useful as GenAI1, we can be pretty sure it isn't creating anything.
- NoGravitas 3y ago
  It will become worse, to a greater degree than you would naively expect (Model Autophagy Disorder).
mort96 3y ago
Wow this is impressively heavy on the genocide apologia for being a piece about humility.
NoGravitas 3y ago
Rationalist bozo apologizes for previously being right.
nojvek 3y ago
The unintuitive thing about self driving cars is when we drive it’s not just about the source, destination, road lights and signs. That may be the 99% but the last 1% is all sorts of crap on the road that one has to triage in milliseconds whether it’s safe or not to run over. Pedestrians slight gestures, animals on the road, construction, police, wet cement, pot holes, fallen trees etc. One needs to have somewhat a human experience and know the physics and behavior of almost all objects, including infering and learning on the fly unknown objects and environments. Now if you build a system that does that, not only have you solved self driving cars, but robotics itself. And if you solved robotics, that is inches away from AGI. Only a matter of time before it’s learned all physical trades, and only a matter of time a few humans use an army of robots to take over, or the robots themselves doing it in the goal of self preservation. So inventing AGI is kind of conditional to L5 self driving and once you solve AGI, it’s a very different unpredictable world. I fundamentally believe alignment is impossible. Sure you can align AGI to a few powerful humans but something aligned to all humans is very unlikely going to happen.
taylodl 3y ago
Today's AI is simply a great way of indexing already-known information and making it readily accessible via a prompt or an API. That's extremely useful and will yield new levels of productivity, but it's not what we generally think of as being "AI."

63 points by nsoonhui 3y ago

If he was as opinionated and aggressive in the podcast as he is in this writing he has to live with it.

> civilization-altering trajectory On which planet? Because i don't see any of it. AI should have made my console monkey job obsolete, by yesterday.

bayindirh 3y ago
Don't forget that many of us normalized scraping others' work, getting rid of the license, generating stuff based on these works and labeling them originals or "new", thinking that generative models are pulling these things out of thin air. Also, same people learnt to get angry on anyone who points out that there's most probably a license violation happened during the process, and these angry people believe that everything is fair use (if you're powerful enough).
its-summertime 3y ago
Is it impacting hiring decisions? Changes in government policy? etc. If not already, how about in the next 5 years? A majority of the use-cases are not going to be publicly attributed to AI, that however does not mean it isn't having an effect.
- rsynnott 3y ago
  > Is it impacting hiring decisions? I mean, probably, sure, for some (generally poorly run) companies, but, when it comes to it, all 15 of the last two recessions have impacted hiring decisions. Companies, and particularly poorly-run companies, jump at shadows all the time.
  - TheOtherHobbes 3y ago
    It's not as if those recessions were partly the result of quant software making poor decisions.
    - rsynnott 3y ago
      My point is that a surprising number of hiring/layoff decisions are essentially made based on recessions which _never actually happen_. Possibly the most spectacular in recent years was in early 2020, when a bunch of tech companies laid off their recruitment staff in prep for the recession which was surely coming... That didn't generally work out well for them.
- Jensson 3y ago
  Most of the current effects are due to AI hype, not due to AI itself. Regulations are trying to get ahead of AI, the reason it tries that is due to AI hype. Same with unions fighting against AI etc. Maybe that hype turns true, but if all AI development plateaued today and no new improvements were made to it then that AI's impact on the world would be very minimal. A useful tool for professionals, but not much more than that.
- altdataseller 3y ago
  Technology that isn’t as advanced as AI is already impacting hiring decisions. When you submit your resume, most ATS systems rank you by a score
- aleph_minus_one 3y ago
  > Is it impacting hiring decisions? [...] If not already, how about in the next 5 years? At least in the field of activity that I work in: No. I honestly don't have the slightest idea how AI could be really helpful for hiring decisions. The only "useful" usage of AI in hiring is to serve as a scapegoat for covering your a... if the hiring decision turned out to be a bad idea ("but the AI said ...").

SynasterBeiter 3y ago

[flagged]

OJFord 3y ago

This just seems silly to bother to defend? I followed the link to 'ridiculed on Twitter' expecting it to be horrible, 'oh yeah well I guess if you feel that personally attacked of course you'll think you have to do something'.. but it's not really? It's just someone pointing it out and yeah it's kind of funny in hindsight? Have a laugh and move on?

pharmakom 3y ago

The latest LLMs are remarkable, but I think the AI Doomer claims are still a reach. My prediction is that the current AI boom will fizzle out into a handful of useful products and a lot of smoke from VC cash. Where are the moon bases? Supersonic jets? Asteroid mines? Self driving cars? We’ve gotten over excited so many times in the past.

FeepingCreature 3y ago
To be fair, none of those are ultimately a matter of "can't" so much as "don't really want to." When we got a billionaire who wanted serious space colonization, we got SpaceX, which is currently working on a moon lander that qualifies as a base in its own right. And of course, we had supersonic jets, there just wasn't enough demand. People want cheap flights more than super-fast flights. We often get excited about these things, but society usually doesn't. That may be one way in which the current AI boom is different.
- BigJono 3y ago
  Or it might be one way in which it's exactly the same.
  - FeepingCreature 3y ago
    I think you're underestimating the hype potential of "it's an app that I can have a normal conversation with."
bayindirh 3y ago
They take too long to build and require that thing called engineering which requires blood sweat and tears. On the other hand, you can scrape the internet, build a model, semi-rig a couple of demos, hype the product and earn money. Don't forget, it's all about money. Product is just a means to get money. Building good things and earning good money as a byproduct is a thing of the old. Boomer stuff. Modern people don't do that anymore. It's not efficient, capitalist and quick enough.

aleph_minus_one 3y ago

"For that matter, hardly anyone predicted the staggering, civilization-altering trajectory of neural network performance from roughly 2012 onwards." Whether the trajectory will be civilization-altering is yet to be seen. Let me put it this way: I have serious doubts.

viraptor 3y ago
It's already been common-behaviour altering in many ways. I'm not sure if it counts as civilisation altering, but the way we create art, get creative review, find and consume large documents have suddenly changed. Not for the majority yet, but it's only a matter of time. For the first time we can get a knowledgeable ad-hoc assistant anywhere, immediately. Even if it's been bad in many ways, it's improving almost every day.
- orwin 3y ago
  > the way we create art, get creative review, find and consume large documents have suddenly changed. I disagree for your first two points. I do use generative AI to create image for my SWADE/DnD campaigns, but this is not art, this is illustration. There is no story behind the style, there is no story behind the color choice, or the meaning of the portraits. AI was able to imitate Art since at least imagemagik. Kazimir Malevich's art, at least. Music is the same. Unless you think a DJ mixing up without mods or adding anything is an artist, in this case you might consider AI music art. I consider it entertainment. Never got anything creative from ChatGPT, even when i was paying for it. Bing chat (and copilot) is great to replace google, scaffold a lot of my code, and definitely boosted my productivity somewhat. But there's a reason why i don't use it to write my scenarii (still use it to spellcheck and syntax check), and even dialogs i have given up on (faster to prepare it myself in the end).
kashyapc 3y ago
Yeah; it is absurd hyperbole. The only person I've seen talk sensible on these topics is Stuart Russell of "Human Compatible" (read the book, it's written with great clarity). He has his head firmly on his shoulders and eschews the breathless hype.

Jensson 3y ago

> He seems to have thought someone was going to discover a revolutionary “key” to AI. That didn’t happen; you might say I was right to be skeptical of it. Transformer architecture happened, that is key for neural networks to build up context dependent reasoning, we wouldn't have gotten to where we are today without it. Without it scaling neural networks doesn't add much value, since without being able to separate out contexts they fail to develop a large amount of separate skills within the same model. So yes, a very important key was found, it wasn't just scaling that got us here.

treprinum 3y ago
Transformers are synonymous with scaling as it was the first model that kept improving both by adding more and more layers and throwing more training data at it. All the previous models like CNNs, ResNet, LSTMs etc. hit some depth/training size where no progress was happening anymore as gradient was unreliably flowing down.

surprisetalk 3y ago

Yudkowsky is obviously extremely smart, but something about his approach causes me to put up psychic walls against everything he says. To see Aaronson say things like "2%" from within the walls of OpenAI is beyond sobering.

mark_l_watson 3y ago

Scott shouldn’t be hard on himself at all for opinions stated 15 years ago. Even over short time spans of a few years, I change my perspective quite a bit. In the 1980s I was lucky enough to stumble into the opportunity of serving on a DARPA neural networks tools panel for a year and getting lucky applying a simple backprop model to a show-stopper problem for a bomb detector my company designed and built for the FAA. Bonus time! Decades went by, and then deep learning really changed my view of AI and technology (I managed a deep learning team at Capital One, and it was a thrill to see DL applications there). Now I am witnessing the same sort of transformations driven by attention based LLMs. It is interesting how differently people now view pros/cons/dangers/this-shit-will-save-the-world possibilities of AI. Short anecdote: last week my wife and I had friends for dinner. Our friends, a husband and wife team who have decades of success writing and producing content for movies and now streaming. I gave them a fairly deep demo of what ChatGPT Pro could do for fleshing out story ideas, generating images for movie posters and other content, etc. The husband was thrilled at the possibility of now being able to produce some of his previously tabled projects inexpensively. His wife had the opposite view, that this would cause many Hollywood jobs to be lost, and other valid worries. Normally our friends seem aligned in their views, but not in this instance.

9991 3y ago
Your take is that you’re wrong a lot, so it’s OK others to be wrong? If the stakes are high, we should be learning how to not make mistakes rather than how to make excuses after the fact.
- mark_l_watson 3y ago
  I think you misunderstood what I was saying, so I will try to be more clear: I was describing myself as an observer and participant in different waves of AI tech. I was not admitting to being wrong, rather, just someone who was lucky enough to be a small part of AI. What I don’t know right now: if AI will help solve difficult societal/energy/medical/scientific problems and propel humanity into a better future (I bet on this outcome) or that the AI-doomers are correct (not my view). I try to absorb the AI dangers arguments and keep an open mind. Good resources: https://podcasts.apple.com/us/podcast/your-undivided-attention/id1460030305 https://podcasts.apple.com/us/podcast/your-undivided-attenti... and I also think that privacy advocates (see books Surveillance Capitalism, and Privacy is Power) are useful in deciding what we should and shouldn’t do with AI.

fidotron 3y ago

It has become clear that the defining route to riches this century is to persuade the already powerful of a huge threat to the status quo, then claim that you offer the way to control it, and ideally turn it into a mechanism for further entrenching established interests. It may have always been this way and I am just getting old.

anonymousDan 3y ago
Finding ways to make rich people richer will always make solid business sense unfortunately.
- Jensson 3y ago
  Making any group of people richer is good business sense as long as those riches doesn't come from you, since then you can take a share of that. That include unions taking a share of worker salaries in order to make those workers make a bigger salary.

MrScruff 3y ago

I think a lot of his defence here is "No-one could have known exactly what was going to happen and no-one knows what will happen next." This is obviously true - predicting the future is hard. It doesn't however explain giving a timeline of thousands of years, which is a ridiculously long time for anything you believe to be technically feasible.

samirillian 3y ago

I think he's just wrong about being wrong now. I'll believe it when AI invents a joke. I've still seen 0 creativity, it's just an aggregator.

sigmoid10 3y ago

This article is absolutely pointless. The statement was from 2009. Back then, neither side had any real evidence in favour of their argument. Deep learning and AI were still purely academic experiments, with zero practicality. And it had been like this for half a century. Back then, even the best models couldn't tell cats from dogs. Today every high schooler with a laptop can solve that problem thanks to abundant hardware and libraries. So both sides were just making up random numbers. This should be a lesson about people, despite their expertise, talking out of their ass instead of reminiscing famous quotes like "horses are better than cars." That statement is also funnily wrong in today's world, but at the time (i.e. without gas stations and roads and infrastructure everywhere), it too was rather reasonable.

T-A 3y ago
> This article is absolutely pointless. Not at all, but maybe you didn't read far enough to get to it. > The statement was from 2009. Back then, neither side had any real evidence in favour of their argument. Deep learning and AI were still purely academic experiments, with zero practicality. That's exactly what the article says: I was explaining that there was no trend you could knowably, reliably project into the future such that you’d end up with human-level AI. And in a sense, I was right. and then it explicitly states the point: The trouble, with hindsight, was that I placed the burden of proof only on those saying a dramatic change would happen, not on those saying it wouldn’t. Note that this is the exact same mistake most of the world made with COVID in early 2020. I would sum up the lesson thus: one must never use radical ignorance as an excuse to default, in practice, to the guess that everything will stay basically the same.
- sigmoid10 3y ago
  >maybe you didn't read far enough to get to it. Perhaps you didn't read my comment far enough to get it. The point is - essentially - you can't trust experts in any field when they start arguing beliefs instead of science. It has nothing to do with confidence in technological pacing or lack thereof. It seems the author has learned nothing of his real mistake and would be prone to repeating it in the future.
3y ago

deleted 3y ago

[deleted]

its-summertime 3y ago

> Eliezer himself didn’t believe that staggering advances in AI were going to happen the way they did, by pure scaling of neural networks. I'd say its more than just scaling, only the smallest forms run on a modern phone, slowly, with caveats. Its far beyond anything reasonable. I still find it weird that there are probably multiple datacenters worth of compute just generating text.

NoGravitas 3y ago
Text, waste heat, and CO2 emissions.

_cjse 3y ago

I decided early on that wasting my one existence trying to solve a problem that seemed unsolvable wasn't what I wanted to do, especially given the stakes (it's very easy to reason yourself into working 14 hour days if you think it means saving the world is 0.001% more likely). However, I never found a satisfying argument against the default outcome being doom. The closest I ever came to a "solution" is to target the economic forces which lead to people researching and innovating on AI. I eventually found fine-based bounties to be an unusually potent weapon, not only here, but against all kinds of possible grey- and black-urn technologies. I wrote up my thoughts very briefly about a year ago, and they still live at [url-redacted], but I suspect the argument is fundamentally flawed in a way I as a non-academic don't have time to suss out. So I find myself in a strange place: Live my life mostly as normal, with a good chunk of my finances in low cost index funds, just in case the exponential starts shooting up - and just in case we don't all perish soon afterwards. C'est la vie.

deleted 3y ago

[deleted]

roenxi 3y ago

The major mistake - some people have been getting this right - is looking at algorithms rather than processing power. The people who were just following the exponential curves [0] pointed out that we'd be hitting human-brain levels of processing power some time around now. Turns out intelligence isn't complicated; it just needs a lot of brute force matrix math. This blog post can be interpreted as "I didn't realise what it was like living through an exponential process". Things happen very quickly. [0] https://spectrum.ieee.org/estimate-human-brain-30-times-faster-than-best-supercomputers https://spectrum.ieee.org/estimate-human-brain-30-times-fast...

deleted 3y ago

[deleted]

renegat0x0 3y ago

"""thereby ensuring that both camps would sneer at me equally.""" In modern polarized environment you have to be hot or cold. In this example you either have to be AI doomer, or not. Nuances are not allowed, you will be voted down by both sides of argument. People flock together in groups and sneer at one another with superiority.

Xcelerate 3y ago

> Eliezer himself didn’t believe that staggering advances in AI were going to happen the way they did, by pure scaling of neural networks. He seems to have thought someone was going to discover a revolutionary “key” to AI. That didn’t happen; you might say I was right to be skeptical of it. It’s interesting so many people in the field thought neural networks would not lead to AI. Back when I started working with them around 2013, I thought we’d have AGI by 2030 (which was an especially quacky view back then that has now become an only slightly quacky view), but I also believed there was absolutely no way neural networks would be the approach that got us there. They seemed like fancy regression or curve interpolators—good perhaps for approximating molecular energies in an efficient way but not capable of having a conversation with me. The “magic” that I thought neural networks were missing was algorithmic capability. Sure, they are universal function approximators, but that’s a bit of a hack theorem, and I didn’t think there was a realistic way to make use of that mathematical oddity; how could one practically train a neural network to compute a SHA256 hash? In fact, I still don’t think NNs can do that. But what I failed to realize, however, is that perhaps they could write the code to generate the hash. In retrospect, it seems kind of obvious, because of course the human brain can’t compute a hash function either—we just write code to do it as well. Computer programs today seem to fall into one of two categories: - “soft”: statistical learning or iterative linear algebra (NNs, SVMs, spectral methods, Monte Carlo, embeddings) - “hard”: rigid, algorithmic, discontinuous (cryptography, mathematical proof systems, discrete optimization) While most processes that occur in the human brain are probably characterizable as “soft”, I thought the uniqueness of human intelligence was due to a small but powerful amount of “hard” processing—and that we required a breakthrough in this area to achieve human-level AI. The release of GPT 3 immediately killed this viewpoint for me. That said, while I now believe we may be able to achieve AGI using “soft” computation alone, I still think that achieving optimal AGI will require extremely “hard”, algorithmic computation. Optimal AGI would be that which performs better than any other computable algorithm on a very general problem space given some reasonable objective function. It’s quite possible there are many different starting points (non-optimal AIs) for getting there—neural networks being one of them—but as these systems recursively improve themselves, my guess is that they all end up converging on one universal, algorithmic, optimal AGI.

orwin 3y ago

Just a small question about that: If we train a generative AI on AI text, is it becoming better, worst, or the same? Because if GenAI2, trained on GenAI1 production, is less useful or as useful as GenAI1, we can be pretty sure it isn't creating anything.

NoGravitas 3y ago
It will become worse, to a greater degree than you would naively expect (Model Autophagy Disorder).

mort96 3y ago

Wow this is impressively heavy on the genocide apologia for being a piece about humility.

NoGravitas 3y ago

Rationalist bozo apologizes for previously being right.

nojvek 3y ago

The unintuitive thing about self driving cars is when we drive it’s not just about the source, destination, road lights and signs. That may be the 99% but the last 1% is all sorts of crap on the road that one has to triage in milliseconds whether it’s safe or not to run over. Pedestrians slight gestures, animals on the road, construction, police, wet cement, pot holes, fallen trees etc. One needs to have somewhat a human experience and know the physics and behavior of almost all objects, including infering and learning on the fly unknown objects and environments. Now if you build a system that does that, not only have you solved self driving cars, but robotics itself. And if you solved robotics, that is inches away from AGI. Only a matter of time before it’s learned all physical trades, and only a matter of time a few humans use an army of robots to take over, or the robots themselves doing it in the goal of self preservation. So inventing AGI is kind of conditional to L5 self driving and once you solve AGI, it’s a very different unpredictable world. I fundamentally believe alignment is impossible. Sure you can align AGI to a few powerful humans but something aligned to all humans is very unlikely going to happen.

taylodl 3y ago

Today's AI is simply a great way of indexing already-known information and making it readily accessible via a prompt or an API. That's extremely useful and will yield new levels of productivity, but it's not what we generally think of as being "AI."