3 ms·
> As far as I know, those are for experiments that directly interact with humans as part of the experiment itself. Or use certain kinds of data from humans. Fo
by joshuamorton 6y ago
> As far as I know, those are for experiments that directly interact with humans as part of the experiment itself.
Or use certain kinds of data from humans. For example, a machine learning project on medical data (even anonymized medical data) probably needs an IRB approval to gain access to, say, a dataset of cancer imaging. A facial recognition model doesn't. What makes those fundamentally different (arguably the facial image is more identifying).
> However the incident in question is really about a different kind of thing - it's asking researchers to speculate on the future ramifications of their research as it pertains to progressive ideals
I see no actual support for this claim in any of the actual documentation on the broader impact statement or its use.
The Neurips docs link to 4 blog posts and papers for inspiration/advice to a broader-impact-statemet-author[0][1][2][3][4]. None focus on minorities or the environment in the way you describe, unless you mean "environment" in the broadest sense of "society".
[0]: https://nips.cc/Conferences/2020/PaperInformation/NeurIPS-FAQ https://nips.cc/Conferences/2020/PaperInformation/NeurIPS-FA... ("How should I write the Broader Impact section?"_
[1]: https://brenthecht.com/papers/FCADIscussions_NegativeImpactsPost_032918.pdf https://brenthecht.com/papers/FCADIscussions_NegativeImpacts...
[2]: https://brenthecht.medium.com/suggestions-for-writing-neurips-2020-broader-impacts-statements-121da1b765bf https://brenthecht.medium.com/suggestions-for-writing-neurip...
[3]: https://medium.com/@GovAI/a-guide-to-writing-the-neurips-impact-statement-4293b723f832 https://medium.com/@GovAI/a-guide-to-writing-the-neurips-imp...
[4]: https://arxiv.org/pdf/1912.06979.pdf https://arxiv.org/pdf/1912.06979.pdf
- defen 6y agoIt's in link number [3] that you posted in the section called "C — Types of societal impact"
- joshuamorton 6y agoI'm still a bit confused, yes, those are two possible concerns. I didn't deny that. You seem to imply that there's some kind of purity test here, and I'm missing the kind of logical connection between the 7 potential categories of broader impacts listed in that list, each with multiple subcategories, and your claim >it's asking researchers speculate on the future ramifications of their research as it pertains to progressive ideals - in practice this means, "How could this negatively affect minorities or the environment?" The framing appears to be far broader than just that, and the "ritualistic" concern you note appears to be unsubstantiated given the other areas for broad impact, and in practice given that for a lot of concrete ML applications, the broader impact statements appeared to be mostly focused on things like efficiency (or just platitudinal), as noted by other commenters.
- defen 6y ago> in practice given that for a lot of concrete ML applications, the broader impact statements appeared to be mostly focused on things like efficiency (or just platitudinal), as noted by other commenters. If they're just platitudes or remarks about efficiency, why are some people so strongly opposed to including them, and some people so strongly in favor of including them? Basically, why does anyone care?
- joshuamorton 6y agoAs I understand it, the idea was that neurips said "hey lets try adding them to everything, and see what happens". And a lot of people gave a huge amount of backlash to this experiment for, as far as I can tell, reasons that amount to this being a form of liberal/leftist censorship. We're talking about, in this case, at least one person who is so scared of "wokism" that after Neurips changed its name from Nips to Neurips, he advocated for them to change it back, to, uhh, stick it to woke people I think?
- mcguire 6y agoEven implying that your work might have downsides could negatively affect your funding. Anything that isn't frolicking unicorns and rainbows is kind of verboten.
- zeckalpha 6y agoAs grants get larger they want you to be explicit about your risks, rather than ignore them.