7 ms·

The Dark Ages of AI (1985) [pdf]

85 points by fpoling 7y ago

dang 7y ago
Url changed from https://aaai.org/ojs/index.php/aimagazine/article/download/494/430 https://aaai.org/ojs/index.php/aimagazine/article/download/4... to one that doesn't do an auto download.
tim333 7y ago
There was quite an interesting take on the period by Moravec on how the hardware available had stagnated during that period (https://jetpress.org/volume1/moravec.htm https://jetpress.org/volume1/moravec.htm). The 1 million instructions per second compares with say the $120 "Best budget graphics card AMD Radeon RX 570" today which does 5,100,000 million instructions per second so quite a difference. >Funding improved somewhat in the early 1980s, but the number of research groups had grown, and the amount available for computers was modest. Many groups purchased Digital's new Vax computers, costing $100,000 and providing 1 MIPS. By mid-decade, personal computer workstations had appeared. Individual researchers reveled in the luxury of having their own computers, avoiding the delays of time-shared machines. A typical workstation was a Sun-3, costing about $10,000, and providing about 1 MIPS. >By 1990, entire careers had passed in the frozen winter of 1-MIPS computers, mainly from necessity, but partly from habit and a lingering opinion that the early machines really should have been powerful enough. In 1990, 1 MIPS cost $1,000 in a low-end personal computer. There was no need to go any lower. Finally spring thaw has come. Since 1990...
gumby 7y ago
Everything that Drew McDermott thought wouldn't really happen did: > "To sketch a worst case scenario, suppose that five years from now the strategic computing initiative collapses mis- erably as autonomous vehicles fail to roll. The fifth gen- eration turns out not to go anywhere, and the Japanese government immediately gets out of computing. Every startup company fails. Texas Instruments and Schlumber- ger and all other companies lose interest. And there’s a big backlash so that you can’t get money for anything con- nected with AI. Everybody hurriedly changes the names of their research projects to something else. This condition, called the “AI Winter” by some, prompted someone to ask me if “nuclear winter” were the situation where fund- ing is cut off for nuclear weapons. So that’s the worst case scenario. > "I don’t think this scenario is very likely to happen, nor even a milder version of it." Exactly that happened, from the autonomous vehicles not panning out to funding evaporating. I remember it well. Then Waldrop's comment could almost have been written last week (except for the loss of Marvin, RIP), down to the confusion between computers and "AI". This Time It's Not Different. Edit: I actually attended this panel.
- 6gvONxR4sf7o 7y ago
  This time is different. This line doesn't seem to apply so well today: >The computer seems to be a mythic emblem for a bright, high-tech future that is going to make our lives so much easier. This time, there's a big groundswell of distrust and anger against "Big Tech."
  - gumby 7y ago
    > "The computer seems to be a mythic emblem for a bright, high-tech future that is going to make our lives so much easier." This time, there's a big groundswell of distrust and anger against "Big Tech." There was a huge level fear about digital tech (and others, like nukes) from the 60s ("Do not fold, spindle or mutilate" was widely cited as a sign of soulless Big Tech) through the 80s (with its fear of 1984 and future shock). If anything today is much more accepting of increased digitization of life. Certainly today people fear AI and computing to a much smaller degree than in the 1980s. There is some distrust of the big tech companies now, but still far from the level of the 60s. I don't remember the 60s that well but certainly when I was in University in the early 80s a lot of nontechnical stuff we read at MIT was on the perspectives of technology from the 60s-80s.
    - 6gvONxR4sf7o 7y ago
      Pardon my ignorance then. Would it be accurate to distinguish between fear of tech (high then, low now) versus tech enabled capitalism (??? then, high now)?
      - gumby 7y ago
        I don't think there's much fear of technology right now; certainly it's at its lowest in my lifetime. There is some hysteria whipped up by the press and certain politicians against a few large corps, but it's no different from any other short-term hysteria. For the press it's understandable: FB et al challenge their position, an environment in which many had set their careers. S why not attack it? For the politicians it's the usual grab bag of short term points scoring. What there isn't is fear of big corps; Boeing will be bailed out and ADM , Monsanto, Exxon et al get to do whatever they want and essentially zero percent of the people complain. Likewise most people like their phones and other technical devices (fans, air fryers, banana slicers and internet-connected sex toys). There's little of the existential dread that annoyingly used to be factored into most decisions. The closest today are the utterly fabricated threats of terrorism, dope fiends, and rabid invaders. Which while widely discussed only seem to bother a few margins figures.
YeGoblynQueenne 7y ago
And here's an editorial about the AI winter that actually did happen, starting around five years after Drew McDermott's opening comment, just for that extra bit of cosmic irony: Avoiding Another AI Winter James Hendler, Rensselaer Polytechnic Institute https://www.computer.org/csdl/magazine/ex/2008/02/mex2008020002/13rRUyeCkdP https://www.computer.org/csdl/magazine/ex/2008/02/mex2008020...
lisper 7y ago
There is some frighteningly prophetic speculation here, and not just about AI: "Governments can use large databases to violate people’s privacy and to harass them. For that matter, credit card companies can do that, too. One can even envision a natural language system that monitors telephone conversations." Written in 1985. Before the Internet. Wow.
- PavlovsCat 7y ago
  > Now the police dreams that one look at the gigantic map on the office wall should suffice at any given moment to establish who is related to whom and in what degree of intimacy; and, theoretically, this dream is not unrealizable although its technical execution is bound to be somewhat difficult. If this map really did exist, not even memory would stand in the way of the totalitarian claim to domination; such a map might make it possible to obliterate people without any traces, as if they had never existed at all. I guess one could also call that "map" a social graph, right? That was written by Hannah Arendt in "The Origins of Totalitarianism", in 1951. Sebastian Haffner in "Germany: Jekyll & Hyde (1939 - Deutschland von innen betrachtet)" (1940), page 162, rough translation by me: > Another circumstance has to be mentioned, which was favourable for the Nazis and their terribly powerful apparatus of oppression: the development of modern technology creates an advantage for the rulers over the ruled, which hasn't been sufficiently understood for a long time. [..] The Bastille could not be successfully stormed in the age of airplanes and tear gas. [..] Transportation has lead to countries becoming small and can be easily surveilled. How many hideouts existed in a country a hundred years ago! Any [amount of] power ran up against its natural limitations. Today there is nowhere to hide for the rebel. Even the thoughts, which can pass through walls, can be "controlled", because they are tied to the distribution of news en masse, to radio, film and press. How long until every house has its own microphone and every private word, like today every telephone conversation, can be listened in on? The ant state is at hand. Perhaps it is no coincidence that states like Germany and Russia have raised technology to the rank of a religion. At the same time this development makes the conservation of freedom a task for humanity that has more urgency than ever. But this is besides the current topic. For the sake of completeness (translating stuff in a hurry never feels quite right) the German original: > Noch ein weiterer Umstand muß erwähnt werden, der sich für die Nazis und ihren ungeheuer mächtigen Unterdrückungsapparat als günstig erweist: Die Entwicklung der modernen Technik verschafft den Herrschenden, wie man lange ungenügend verstanden hat, einen Vorteil gegenüber den Beherrschten. Je wirksamer die Waffen werden und je weniger man sich gegen sie schützen kann, desto mehr ist der Bewaffnete den Unbewaffneten überlegen. Die Bastille könnte im Zeitalter der Flugzeuge und des Tränengases nicht erfolgreich erstürmt werden. Mit Gewehren ausgerüstete Bürgerwehren haben keine Chance mehr gegen motorisierte Polizeitruppen; es hat keinen Sinn, Barrikaden gegen eine Regierung zu errichten, die über Panzer verfügt. Und nicht nur die Waffenentwicklung begünstigt im Falle einer Revolution die Machthaber, den Staat gegenüber den einzelnen: Die moderne technische Entwicklung und die damit einhergehende ausgeklügelte Organisation wirken in der gleichen Richtung. Der Verkehr hat dazu geführt, daß die Länder klein geworden sind und sich leicht überwachen lassen. Wie viele Verstecke hab es in einem Land vor hundert Jahren! Jede Macht stieß damals gegen natürliche Schranken! Heute gibt es kein Schlupfloch und keinen Schlupfwinkel mehr für den Rebellen. Selbst die Gedanken, die Mauern zu durchdringen vermögen, sind "steuerbar" geworden, da sie an die massenhafte Verbreitung von Nachrichten, an Rundfunk, Film und Presse, gebunden sind. Wie lange wird es dauern, bis jedes Haus sein eigenes Mikrofon hat und jedes private Wort, wie heute jedes Telefongespräch, abgehört werden kann? Der Ameisenstaat ist nahe. Es ist vielleicht kein Zufall, daß solche Staaten wie Deutschland und Rußland die Technik in den Rang einer Religion erhoben haben. Umgekehrt macht diese Entwicklung der modernen Technik die Bewahrung der Freiheit zu einer Menschheitsaufgabe, die dringlicher denn je ist. Aber das führt zu weit ab vom jetzigen Thema.
tachyonbeam 7y ago
I wonder if it's not just a question of human nature for things to go into a cycle of overhyped boom and bust. People get very excited about something, progress doesn't happen fast enough, and then they get bored and move on to something else. If we look at Google Trends, it looks like "deep learning" has hit a plateau back in 2017: https://trends.google.com/trends/explore?date=all&geo=US&q=deep%20learning https://trends.google.com/trends/explore?date=all&geo=US&q=d... Artificial intelligence peaked in January 2018: https://trends.google.com/trends/explore?date=all&geo=US&q=artificial%20intelligence https://trends.google.com/trends/explore?date=all&geo=US&q=a... I work in AI and I'm very much thinking that another AI winter could come. I find myself wondering where are all the real-world AI deployments, and how effective they are. To my knowledge, there aren't super successful AI startups out there. There are startups getting a lot of investor money for AI research, but they do not have profitable business models. The venture capitalists are going to get tired of that at some point, if they aren't already.
- sdenton4 7y ago
  There's a bunch of extremely valuable progress in less glamorous areas, like data center operations: https://www.datacenterknowledge.com/google-alphabet/google-switching-self-driving-data-center-management-system https://www.datacenterknowledge.com/google-alphabet/google-s...
- mark_l_watson 7y ago
  I think that we see what could be called “fear of missing out” of profits and benefits for AI. I have also been working in the field since 1982. Deep learning is a great technology but should be hurt by the lack of explainability and what I would call massive technical debt of not understanding how systems work. Exciting times, though.
- Veedrac 7y ago
  Would you be less worried if the graph was still going up? If it was already falling?
lhotkins 7y ago
I wonder when the next article like this will reappear... I mean it seems to be the case in AI that periods of hype and periods of winter regularly change and it seems we’re reaching the pinnacle of hype of our latest form of AI

85 points by fpoling 7y ago

dang 7y ago

Url changed from https://aaai.org/ojs/index.php/aimagazine/article/download/494/430 https://aaai.org/ojs/index.php/aimagazine/article/download/4... to one that doesn't do an auto download.

tim333 7y ago

There was quite an interesting take on the period by Moravec on how the hardware available had stagnated during that period (https://jetpress.org/volume1/moravec.htm https://jetpress.org/volume1/moravec.htm). The 1 million instructions per second compares with say the $120 "Best budget graphics card AMD Radeon RX 570" today which does 5,100,000 million instructions per second so quite a difference. >Funding improved somewhat in the early 1980s, but the number of research groups had grown, and the amount available for computers was modest. Many groups purchased Digital's new Vax computers, costing $100,000 and providing 1 MIPS. By mid-decade, personal computer workstations had appeared. Individual researchers reveled in the luxury of having their own computers, avoiding the delays of time-shared machines. A typical workstation was a Sun-3, costing about $10,000, and providing about 1 MIPS. >By 1990, entire careers had passed in the frozen winter of 1-MIPS computers, mainly from necessity, but partly from habit and a lingering opinion that the early machines really should have been powerful enough. In 1990, 1 MIPS cost $1,000 in a low-end personal computer. There was no need to go any lower. Finally spring thaw has come. Since 1990...

gumby 7y ago

Everything that Drew McDermott thought wouldn't really happen did: > "To sketch a worst case scenario, suppose that five years from now the strategic computing initiative collapses mis- erably as autonomous vehicles fail to roll. The fifth gen- eration turns out not to go anywhere, and the Japanese government immediately gets out of computing. Every startup company fails. Texas Instruments and Schlumber- ger and all other companies lose interest. And there’s a big backlash so that you can’t get money for anything con- nected with AI. Everybody hurriedly changes the names of their research projects to something else. This condition, called the “AI Winter” by some, prompted someone to ask me if “nuclear winter” were the situation where fund- ing is cut off for nuclear weapons. So that’s the worst case scenario. > "I don’t think this scenario is very likely to happen, nor even a milder version of it." Exactly that happened, from the autonomous vehicles not panning out to funding evaporating. I remember it well. Then Waldrop's comment could almost have been written last week (except for the loss of Marvin, RIP), down to the confusion between computers and "AI". This Time It's Not Different. Edit: I actually attended this panel.

6gvONxR4sf7o 7y ago
This time is different. This line doesn't seem to apply so well today: >The computer seems to be a mythic emblem for a bright, high-tech future that is going to make our lives so much easier. This time, there's a big groundswell of distrust and anger against "Big Tech."
- gumby 7y ago
  > "The computer seems to be a mythic emblem for a bright, high-tech future that is going to make our lives so much easier." This time, there's a big groundswell of distrust and anger against "Big Tech." There was a huge level fear about digital tech (and others, like nukes) from the 60s ("Do not fold, spindle or mutilate" was widely cited as a sign of soulless Big Tech) through the 80s (with its fear of 1984 and future shock). If anything today is much more accepting of increased digitization of life. Certainly today people fear AI and computing to a much smaller degree than in the 1980s. There is some distrust of the big tech companies now, but still far from the level of the 60s. I don't remember the 60s that well but certainly when I was in University in the early 80s a lot of nontechnical stuff we read at MIT was on the perspectives of technology from the 60s-80s.
  - 6gvONxR4sf7o 7y ago
    Pardon my ignorance then. Would it be accurate to distinguish between fear of tech (high then, low now) versus tech enabled capitalism (??? then, high now)?
    - gumby 7y ago
      I don't think there's much fear of technology right now; certainly it's at its lowest in my lifetime. There is some hysteria whipped up by the press and certain politicians against a few large corps, but it's no different from any other short-term hysteria. For the press it's understandable: FB et al challenge their position, an environment in which many had set their careers. S why not attack it? For the politicians it's the usual grab bag of short term points scoring. What there isn't is fear of big corps; Boeing will be bailed out and ADM , Monsanto, Exxon et al get to do whatever they want and essentially zero percent of the people complain. Likewise most people like their phones and other technical devices (fans, air fryers, banana slicers and internet-connected sex toys). There's little of the existential dread that annoyingly used to be factored into most decisions. The closest today are the utterly fabricated threats of terrorism, dope fiends, and rabid invaders. Which while widely discussed only seem to bother a few margins figures.

YeGoblynQueenne 7y ago

And here's an editorial about the AI winter that actually did happen, starting around five years after Drew McDermott's opening comment, just for that extra bit of cosmic irony: Avoiding Another AI Winter James Hendler, Rensselaer Polytechnic Institute https://www.computer.org/csdl/magazine/ex/2008/02/mex2008020002/13rRUyeCkdP https://www.computer.org/csdl/magazine/ex/2008/02/mex2008020...

lisper 7y ago

There is some frighteningly prophetic speculation here, and not just about AI: "Governments can use large databases to violate people’s privacy and to harass them. For that matter, credit card companies can do that, too. One can even envision a natural language system that monitors telephone conversations." Written in 1985. Before the Internet. Wow.

PavlovsCat 7y ago
> Now the police dreams that one look at the gigantic map on the office wall should suffice at any given moment to establish who is related to whom and in what degree of intimacy; and, theoretically, this dream is not unrealizable although its technical execution is bound to be somewhat difficult. If this map really did exist, not even memory would stand in the way of the totalitarian claim to domination; such a map might make it possible to obliterate people without any traces, as if they had never existed at all. I guess one could also call that "map" a social graph, right? That was written by Hannah Arendt in "The Origins of Totalitarianism", in 1951. Sebastian Haffner in "Germany: Jekyll & Hyde (1939 - Deutschland von innen betrachtet)" (1940), page 162, rough translation by me: > Another circumstance has to be mentioned, which was favourable for the Nazis and their terribly powerful apparatus of oppression: the development of modern technology creates an advantage for the rulers over the ruled, which hasn't been sufficiently understood for a long time. [..] The Bastille could not be successfully stormed in the age of airplanes and tear gas. [..] Transportation has lead to countries becoming small and can be easily surveilled. How many hideouts existed in a country a hundred years ago! Any [amount of] power ran up against its natural limitations. Today there is nowhere to hide for the rebel. Even the thoughts, which can pass through walls, can be "controlled", because they are tied to the distribution of news en masse, to radio, film and press. How long until every house has its own microphone and every private word, like today every telephone conversation, can be listened in on? The ant state is at hand. Perhaps it is no coincidence that states like Germany and Russia have raised technology to the rank of a religion. At the same time this development makes the conservation of freedom a task for humanity that has more urgency than ever. But this is besides the current topic. For the sake of completeness (translating stuff in a hurry never feels quite right) the German original: > Noch ein weiterer Umstand muß erwähnt werden, der sich für die Nazis und ihren ungeheuer mächtigen Unterdrückungsapparat als günstig erweist: Die Entwicklung der modernen Technik verschafft den Herrschenden, wie man lange ungenügend verstanden hat, einen Vorteil gegenüber den Beherrschten. Je wirksamer die Waffen werden und je weniger man sich gegen sie schützen kann, desto mehr ist der Bewaffnete den Unbewaffneten überlegen. Die Bastille könnte im Zeitalter der Flugzeuge und des Tränengases nicht erfolgreich erstürmt werden. Mit Gewehren ausgerüstete Bürgerwehren haben keine Chance mehr gegen motorisierte Polizeitruppen; es hat keinen Sinn, Barrikaden gegen eine Regierung zu errichten, die über Panzer verfügt. Und nicht nur die Waffenentwicklung begünstigt im Falle einer Revolution die Machthaber, den Staat gegenüber den einzelnen: Die moderne technische Entwicklung und die damit einhergehende ausgeklügelte Organisation wirken in der gleichen Richtung. Der Verkehr hat dazu geführt, daß die Länder klein geworden sind und sich leicht überwachen lassen. Wie viele Verstecke hab es in einem Land vor hundert Jahren! Jede Macht stieß damals gegen natürliche Schranken! Heute gibt es kein Schlupfloch und keinen Schlupfwinkel mehr für den Rebellen. Selbst die Gedanken, die Mauern zu durchdringen vermögen, sind "steuerbar" geworden, da sie an die massenhafte Verbreitung von Nachrichten, an Rundfunk, Film und Presse, gebunden sind. Wie lange wird es dauern, bis jedes Haus sein eigenes Mikrofon hat und jedes private Wort, wie heute jedes Telefongespräch, abgehört werden kann? Der Ameisenstaat ist nahe. Es ist vielleicht kein Zufall, daß solche Staaten wie Deutschland und Rußland die Technik in den Rang einer Religion erhoben haben. Umgekehrt macht diese Entwicklung der modernen Technik die Bewahrung der Freiheit zu einer Menschheitsaufgabe, die dringlicher denn je ist. Aber das führt zu weit ab vom jetzigen Thema.

tachyonbeam 7y ago

I wonder if it's not just a question of human nature for things to go into a cycle of overhyped boom and bust. People get very excited about something, progress doesn't happen fast enough, and then they get bored and move on to something else. If we look at Google Trends, it looks like "deep learning" has hit a plateau back in 2017: https://trends.google.com/trends/explore?date=all&geo=US&q=deep%20learning https://trends.google.com/trends/explore?date=all&geo=US&q=d... Artificial intelligence peaked in January 2018: https://trends.google.com/trends/explore?date=all&geo=US&q=artificial%20intelligence https://trends.google.com/trends/explore?date=all&geo=US&q=a... I work in AI and I'm very much thinking that another AI winter could come. I find myself wondering where are all the real-world AI deployments, and how effective they are. To my knowledge, there aren't super successful AI startups out there. There are startups getting a lot of investor money for AI research, but they do not have profitable business models. The venture capitalists are going to get tired of that at some point, if they aren't already.

sdenton4 7y ago
There's a bunch of extremely valuable progress in less glamorous areas, like data center operations: https://www.datacenterknowledge.com/google-alphabet/google-switching-self-driving-data-center-management-system https://www.datacenterknowledge.com/google-alphabet/google-s...
mark_l_watson 7y ago
I think that we see what could be called “fear of missing out” of profits and benefits for AI. I have also been working in the field since 1982. Deep learning is a great technology but should be hurt by the lack of explainability and what I would call massive technical debt of not understanding how systems work. Exciting times, though.
Veedrac 7y ago
Would you be less worried if the graph was still going up? If it was already falling?

lhotkins 7y ago

I wonder when the next article like this will reappear... I mean it seems to be the case in AI that periods of hype and periods of winter regularly change and it seems we’re reaching the pinnacle of hype of our latest form of AI