4 ms·
> I think it's absolutely morally repugnant to walk past them and not give them money, because instead you're paying people to sit around thinking about AI. Th
by throwawayjava 8y ago
> I think it's absolutely morally repugnant to walk past them and not give them money, because instead you're paying people to sit around thinking about AI.
This is not a new argument. Sister Mary Jucunda, a Zambian nun, wrote to a NASA scientist (Ernst Stuhlinger) in the early 70's with a similar critique of funding for space research.
You can read Ernst's cogent reply here: http://www.lettersofnote.com/2012/08/why-explore-space.html http://www.lettersofnote.com/2012/08/why-explore-space.html
My favorite excerpt follows:
> About 400 years ago, there lived a count in a small town in Germany. He was one of the benign counts, and he gave a large part of his income to the poor in his town. This was much appreciated, because poverty was abundant during medieval times, and there were epidemics of the plague which ravaged the country frequently. One day, the count met a strange man. He had a workbench and little laboratory in his house, and he labored hard during the daytime so that he could afford a few hours every evening to work in his laboratory. He ground small lenses from pieces of glass; he mounted the lenses in tubes, and he used these gadgets to look at very small objects. The count was particularly fascinated by the tiny creatures that could be observed with the strong magnification, and which he had never seen before. He invited the man to move with his laboratory to the castle, to become a member of the count's household, and to devote henceforth all his time to the development and perfection of his optical gadgets as a special employee of the count.
> The townspeople, however, became angry when they realized that the count was wasting his money, as they thought, on a stunt without purpose. "We are suffering from this plague," they said, "while he is paying that man for a useless hobby!" But the count remained firm. "I give you as much as I can afford," he said, "but I will also support this man and his work, because I know that someday something will come out of it!"
> Indeed, something very good came out of this work, and also out of similar work done by others at other places: the microscope. It is well known that the microscope has contributed more than any other invention to the progress of medicine, and that the elimination of the plague and many other contagious diseases from most parts of the world is largely a result of studies which the microscope made possible.
I think there are many parallels between AI/ML and the microscope, and I think safety research is a very reasonable inquisitive lens for developing these new technologies.
- jopsen 8y agoWell, fighting poverty also grows the economy and number of brains available for research in the future. Today we are bringing people out of poverty for good, much charity isn't money in a bottomless pit. The pit has a bottom as evident by the very realistic goal to end extreme poverty by 2030. Still basic research is important, because it has such a long tail. Just saying both approaches have validity and will bring massive progress.
- throwawayjava 8y agoI certainly won't argue with that! We should be spending much more money on poverty reduction than on basic science.
- Nimitz14 8y agoNot remotely applicable. For one, so far everyone predicting doom about AI has been a layman a subject. Maybe you aren't aware, but this is a field that people do PhDs and get professorships in. Noone respected agrees with the doom-sayers.
- throwawayjava 8y ago> Maybe you aren't aware, but this is a field that people do PhDs and get professorships in. I'm aware of my own existence, thanks ;-) > Noone respected agrees with the doom-sayers But many, many, many respected AI researchers (who I've talked to about this) certainly do agree that AI/ML safety/robustness are important topics of inquiry. Including researchers at all the top CS departments, at Deepmind, at OpenAI, etc. Consider critiquing the concrete projects that are funded with AI safety money. Very little of that money flows to research about "preventing malicious superintelligence" or whatever strawman you have in mind. And even projects that consider those questions also consider many much more near-term AI safety questions.
- Nimitz14 8y agoThere is a difference between AI/ML safety/robustness (as in ensuring self driving cars don't behave erratically given unexpected inputs), and the skynet predictions. > Consider critiquing the concrete projects that are funded with AI safety money. Very little of that money flows to research about "preventing malicious superintelligence" or whatever strawman you have in mind. And even projects that consider those questions also consider many much more near-term AI safety questions. But this ("preventing malicious superintelligence") is EXACTLY what we are talking about. The comment in the OP was quoting the following > Grants will likely go to organizations that seek to reduce global catastrophic risks, especially those relating to advanced artificial intelligence.