2 ms·

> This isn't just a matter of knowledge and familiarity. It requires some intensely personal moral and ethical judgments. One person's moral evil (self-driving

> This isn't just a matter of knowledge and familiarity. It requires some intensely personal moral and ethical judgments. One person's moral evil (self-driving trucks putting truckers out of work) might be another's moral obligation (getting rid of the life-shortening occupational hazards of trucking). Absolutely. We shouldn't expect the authors of one paper to decide on the utility of various consequences and alternatives. Also, those consequences don't exist in a vacuum, and depend on other assumptions. Eg: Automating jobs is possibly an ethical positive provided people don't need jobs to survive. And this provides an opportunity to kick off other lines of research and inquiry. > ...excessive costs from false positives... Could someone give concrete examples of the possible costs of "false positives"? In the picture I have in mind, papers are not accepted/rejected based on whether someone likes the consequences or not. (as stated in the article) > It's just possible that researchers should not assume that they're equipped to make long-term predictions or shape the efforts of their peers around said predictions. I think excuses based on insufficient expertise is a cop-out. There is no social science specialization with predictive models such things. The authors are expected to have the most insight into the specific aspects they are writing on, and generally educated well enough to be a functioning citizen of modern society. If they can vote, they can damn well put some thought into possible consequences. -- The way I see it, there are two goals underlying this suggestion: 1. Get a better understanding of the possible consequences of different lines of advancement, and, as a community, encourage the "positive" ones while discouraging the "negative" ones. (for some value of positive/negative, which might well be emergent only after much back-and-forth) 2. Get each and every researcher to actively think about the ethics of their research and the problems they choose to solve. Most commenters are focusing on only the first one; I think the second is equally important. If the focus was mainly on the first problem, we might choose to have editors writing editorials every few months on recent advancements in some topic. Or a conference panel discussing the same. Those will help towards the first goal, but only partially towards the second goal, since most researchers could "outsource" ethics to others.

Kalium 8y ago
> Eg: Automating jobs is possibly an ethical positive provided people don't need jobs to survive. Or maybe automating certain jobs is an ethical positive because means fewer people die in coal pits. You're very right that this is an excellent opportunity to kick off other lines of research and inquiry. It's possible that what is essentially a journal of applied mathematics might not be an ideal venue for such, given that journals of ethics and economics already exist. > Could someone give concrete examples of the possible costs of "false positives"? In the picture I have in mind, papers are not accepted/rejected based on whether someone likes the consequences or not. (as stated in the article) What would be the point of a negative social consequences disclosure requirement if there were no consequences whatsoever for leaving one off or being glaringly silly in the disclosure? The point of this proposed process is that it is ground to reject a paper and require further revision. To put it another way: the process proposed will either have false positives or it will do nothing. The extent to which it has false positives that exact a cost will be determined by the extent to which the process works as intended to discourage research deemed to have negative social consequences. Rejecting a paper might end a grad student's career. It might prevent disclosure of a significant finding in time to have a major impact on something important. We have no way of anticipating the consequences of this. Perhaps this proposal should come with a discussion of the potential negative social consequences of it, given that some can already be reasonably foreseen. Given how abstract that is, I shall offer a more concrete example. My past involves research into how to make circuits more efficient and easily produced reliably and at scale. At no point in this process did anyone stop and think about if this might have applications in computers used as part of weapons systems. Which, looking back, is obviously one application of computers. > The authors are expected to have the most insight into the specific aspects they are writing on, and generally educated well enough to be a functioning citizen of modern society. You're absolutely right. The authors can be expected to have deep and significant insight into the technical or mathematical aspects of their work. It's possible that this might not be the same as having the most insight into economic or social consequences of their work. > 1. Get a better understanding of the possible consequences of different lines of advancement, and, as a community, encourage the "positive" ones while discouraging the "negative" ones. (for some value of positive/negative, which might well be emergent only after much back-and-forth) This is a laudable goal! And it's perhaps worth considering if there might be unintentional and perhaps "negative" side effects to such a process. > 2. Get each and every researcher to actively think about the ethics of their research and the problems they choose to solve. If this is the goal, then perhaps the requirement should be for every paper to be accompanied with an ethical statement which is in no way part of the review process. That would satisfy your needs without risking significant unintentional side-effects, would it not?
- ssivark 8y ago
  Since the review process is iterative, the reviewer will point out what they consider to be a shortcoming, and the author will fix that part. If they disagree, and the author is keen on not mentioning those concerns even as worth considering, but the paper is otherwise good, we could evolve a system whereby the reviewer comment is published along with the paper. > If this is the goal, then perhaps the requirement should be for every paper to be accompanied with an ethical statement which is in no way part of the review process. That would satisfy your needs without risking significant unintentional side-effects, would it not? How do we stop this ethics statement from being vacuous, unless it is reviewed? It might quickly devolve along the lines of TOS/EULA (legalese to include all edge cases) or reduce to something trivial like: No fingers were harmed while typing up this paper.
  - Kalium 8y ago
    > Since the review process is iterative, the reviewer will point out what they consider to be a shortcoming, and the author will fix that part. That takes a non-zero amount of time, and thus funding. So now we've got a system where disagreeing about someone's forecasting of potential social consequences or their decisions around ethics imposes costs on mathematics. Even processes intentionally and explicitly designed to be iterative have an unfortunate tendency to stop iterating as conditions change. This adds one more reason for papers to not reach publication. > If they disagree, and the author is keen on not mentioning those concerns even as worth considering, but the paper is otherwise good, we could evolve a system whereby the reviewer comment is published along with the paper. That sounds like a good idea. In fact, why not just skip the review portion of it and publish reviewer's comments on a paper's ethics along side it every single time? It would seem to get to the same point more quickly! > How do we stop this ethics statement from being vacuous, unless it is reviewed? Here we have the crux of it: the whole point of this proposal is for there to be real consequences attached. Which brings us back to my point about false positives and side effects. I suspect that in most cases, the statements would correctly be vacuous. Many - probably most - papers in computer science have minimal to no obvious or reasonably forseeable social implications.

Kalium 8y ago

> Eg: Automating jobs is possibly an ethical positive provided people don't need jobs to survive. Or maybe automating certain jobs is an ethical positive because means fewer people die in coal pits. You're very right that this is an excellent opportunity to kick off other lines of research and inquiry. It's possible that what is essentially a journal of applied mathematics might not be an ideal venue for such, given that journals of ethics and economics already exist. > Could someone give concrete examples of the possible costs of "false positives"? In the picture I have in mind, papers are not accepted/rejected based on whether someone likes the consequences or not. (as stated in the article) What would be the point of a negative social consequences disclosure requirement if there were no consequences whatsoever for leaving one off or being glaringly silly in the disclosure? The point of this proposed process is that it is ground to reject a paper and require further revision. To put it another way: the process proposed will either have false positives or it will do nothing. The extent to which it has false positives that exact a cost will be determined by the extent to which the process works as intended to discourage research deemed to have negative social consequences. Rejecting a paper might end a grad student's career. It might prevent disclosure of a significant finding in time to have a major impact on something important. We have no way of anticipating the consequences of this. Perhaps this proposal should come with a discussion of the potential negative social consequences of it, given that some can already be reasonably foreseen. Given how abstract that is, I shall offer a more concrete example. My past involves research into how to make circuits more efficient and easily produced reliably and at scale. At no point in this process did anyone stop and think about if this might have applications in computers used as part of weapons systems. Which, looking back, is obviously one application of computers. > The authors are expected to have the most insight into the specific aspects they are writing on, and generally educated well enough to be a functioning citizen of modern society. You're absolutely right. The authors can be expected to have deep and significant insight into the technical or mathematical aspects of their work. It's possible that this might not be the same as having the most insight into economic or social consequences of their work. > 1. Get a better understanding of the possible consequences of different lines of advancement, and, as a community, encourage the "positive" ones while discouraging the "negative" ones. (for some value of positive/negative, which might well be emergent only after much back-and-forth) This is a laudable goal! And it's perhaps worth considering if there might be unintentional and perhaps "negative" side effects to such a process. > 2. Get each and every researcher to actively think about the ethics of their research and the problems they choose to solve. If this is the goal, then perhaps the requirement should be for every paper to be accompanied with an ethical statement which is in no way part of the review process. That would satisfy your needs without risking significant unintentional side-effects, would it not?

ssivark 8y ago
Since the review process is iterative, the reviewer will point out what they consider to be a shortcoming, and the author will fix that part. If they disagree, and the author is keen on not mentioning those concerns even as worth considering, but the paper is otherwise good, we could evolve a system whereby the reviewer comment is published along with the paper. > If this is the goal, then perhaps the requirement should be for every paper to be accompanied with an ethical statement which is in no way part of the review process. That would satisfy your needs without risking significant unintentional side-effects, would it not? How do we stop this ethics statement from being vacuous, unless it is reviewed? It might quickly devolve along the lines of TOS/EULA (legalese to include all edge cases) or reduce to something trivial like: No fingers were harmed while typing up this paper.
- Kalium 8y ago
  > Since the review process is iterative, the reviewer will point out what they consider to be a shortcoming, and the author will fix that part. That takes a non-zero amount of time, and thus funding. So now we've got a system where disagreeing about someone's forecasting of potential social consequences or their decisions around ethics imposes costs on mathematics. Even processes intentionally and explicitly designed to be iterative have an unfortunate tendency to stop iterating as conditions change. This adds one more reason for papers to not reach publication. > If they disagree, and the author is keen on not mentioning those concerns even as worth considering, but the paper is otherwise good, we could evolve a system whereby the reviewer comment is published along with the paper. That sounds like a good idea. In fact, why not just skip the review portion of it and publish reviewer's comments on a paper's ethics along side it every single time? It would seem to get to the same point more quickly! > How do we stop this ethics statement from being vacuous, unless it is reviewed? Here we have the crux of it: the whole point of this proposal is for there to be real consequences attached. Which brings us back to my point about false positives and side effects. I suspect that in most cases, the statements would correctly be vacuous. Many - probably most - papers in computer science have minimal to no obvious or reasonably forseeable social implications.