9 ms·
If your work is suddenly and unexpected roadblocked at the last second by internal review, the only way to make changes that prevent that from happening in the
by UncleMeat 6y ago
If your work is suddenly and unexpected roadblocked at the last second by internal review, the only way to make changes that prevent that from happening in the future is to clearly understand the situations and criticisms that led to the roadblock. This is why understanding who raised these concerns is important. Anonymous feedback blowing up a project at the final moments is sure to frustrate anybody. If what she has said is true then it was also very difficult for her to even have access to the substance of the critique in the first place, with the initial story from her management being that she would not be able to see the documents explaining why the paper was to be retracted.
The critique here appears to have been fairly minor, too. Failing to cite some recent research is rarely grounds for rejection.
- siliconmountain 6y agoIsn't the academic journal peer review process generally an anonymous feedback mechanism? Why does this need to be different?
- DonaldPShimoda 6y agoBecause this isn't peer review — or at least, it's not meant to be (per the top-level comment). That's the whole issue, really: there already exists a peer review process to ensure the paper's academic rigor, so why is Google hiding behind a claim of the necessity of anonymity for a corporate (not academic) process?
- ethbr0 6y agoBecause typically your academic journal peers don't work for the same bosses you do.
- whimsicalism 6y ago> academic journal peer review process Fro my understanding, this paper had already passed peer review and been accepted. Google management then decided to block the publication using the IP review process.
- ThomPete 6y agoit got approved without the review from what i understand
- whimsicalism 6y agoBy peer review, I mean review by fellow academics, not Google management.
- tooltalk 6y agoPlease go read the link first. Jeff clearly states that Google has a review protocol for journal submission which requires a two weeks internal review period. Timnit shared the paper a day before the publication deadline, ie, no time for internal review, and someone with a fat finger apparently approved it for submission without the required review.
- geofft 6y agoThat's not under dispute. What's under dispute is: 1) Is the review protocol that requires a two-week review period a peer review process intended to maintain scientific rigor, or an internal controls process intended to prevent unwanted disclosure of trade secrets, PII, etc.? Repeating the comment at the very top of the thread: > Maybe different teams are different, but on my previous team within Google AI, we thought the goal of google's pubapproval process was to ensure that internal company IP (eg. details about datasets, details about google compute infra) does not leak to the public, and maybe to shield Google from liability. Nothing more. If it's not a scientific peer review process, arguments about why scientific peer review is generally anonymous are irrelevant, just like arguments about why, say, code review is generally not anonymous would also be irrelevant. It's a different kind of review process from both of those. 2) In practice, is the two-week review period actually expected / enforced? Other Googlers, including people in her organization, are saying that the two week requirement is a guideline, not a hard rule, and submissions on short notice are regularly accepted without complaint: https://twitter.com/le_roux_nicolas/status/1334624531886071815 https://twitter.com/le_roux_nicolas/status/13346245318860718... https://twitter.com/ItsNeuronal/status/1334636596113510400 https://twitter.com/ItsNeuronal/status/1334636596113510400 https://twitter.com/lizthegrey/status/1334659334689570817 https://twitter.com/lizthegrey/status/1334659334689570817 (I don't work for Google, but I work for another very IP-leak-sensitive employer that does ML stuff, and we have a two-week review period on publications. The two-week rule exists for the purpose of not causing last-minute work for people, but if you miss it, it's totally permissible to bug folks to get it approved, and if they do, it's not considered "someone with a fat finger." It certainly doesn't exist for the purpose of peer review - it's assumed that the venue you're submitting to will do review, and I think everyone understands that someone from your own employer isn't going to be a fair peer reviewer anyway. There is a "technical reviewer" of your choice, but basically they just make sure you're not embarrassing yourself and the company, and there's no requirement for how deeply they review. I think I've gone through the process twice and missed the deadlines both times.) So, if this "rule" exists on paper, but only exists in practice for her, then this is the textbook definition of unfairness.
- UncleMeat 6y agoThis isn't (or wasn't) a review process for scholarship. Oodles of people within Google (even within Brain) have gone through this process and it seems to have always been the case that it just checks for things like PR problems, IP leaks, etc. Further, she claims that initially she was not allowed to even see the contents of the criticisms, only that the paper needed to be withdrawn. Let's say you were working on a feature. At the 11th hour, just before it hit production, you get an email telling you to revert everything and scrap the release. Apparently somebody in the company thought it had problems but they won't tell you the problems. Then after prying you do get to see the criticisms and they look like ordinary stuff that is easily addressed in code review rather than fundamental issues. They still won't tell you who made the critiques. Would you be upset?
- deleted 6y ago[deleted]
- htrp 6y ago>Now might be a good time to remind everyone that the easiest way to discriminate is to make stringent rules, then to decide when and for whom to enforce them. --Nicolas Le Roux
- tomp 6y agoI mean this sounds deep and sensible and I support the underlying sentiment when it comes to laws and government force, but it's not so black-and-white in social situations.. Someone farts once - no big deal. Someone farts all the time => they're quitting or I am.
- SomewhatLikely 6y agoIt would be pretty easy to discriminate if you had loose underspecified rules, then decide action on a case by case basis. The problem seems to not be in the rules but in the deciding.
- dvtrn 6y agoWhy can't it be both? I once observed an instance very early in my career, while working in an employment litigation office where rules were explicitly created in order to box an individual in such that their actions, while completely legal and moral and in the course of their professional duties could be used as grounds for dismissal "because policy". A lawsuit emerged. A settlement followed. Just because "we made rules for this" doesn't mean the scrutiny should suddenly cease.
- threwo324324 6y agoThis is how most 'fascist' states work- theoretical controls on each and every aspect, laxly imposed on everyone but the deplorables.
- nickff 6y agoAs a manager, if someone gives an ultimatum, you basically have to fire them. There's no real option; Ben Horowitz covered it somewhere, but the bottom line is that if you yield, you've given up all control.
- mistermann 6y ago> but the bottom line is that if you yield, you've given up all control. This doesn't seem logical to me. I don't doubt there are indeed scenarios where this is true, but as an absolute, this doesn't resemble my real world experience at all. It seems like kind of the opposite of how human interaction should work.
- cmsj 6y agoIndeed. The very idea of using words like "yield" or "control" belies a fundamental weakness - managers who are so insecure that they can't ever change their minds in case someone figures out how mediocre they are (when in fact the opposite is true - listening to your expert employees and allowing them to change your opinions is seen by them as a sign of strength).
- chaps 6y agoThis sounds incredibly inhumane.
- neltnerb 6y agoUh, or you could compromise with them and act like two adults? This isn't a zero sum game.
- nickff 6y agoIf someone wants to negotiate, they don't use an ultimatum.
- dragonwriter 6y agoIf someone is using an ultimatum, they don't request an in-person discussion. The narratives from the participants on the actual communication differ on key points relevant to evaluating whether it was really an ultimatum.
- jariel 6y ago"and unexpected roadblocked at the last second " This is a essentially false. The author submitted the paper the day before publishing, given there at least was some form of standard review - the actions by Google could not be construed as 'roadblock'. There is no 'roadblocking' and the review was certainly not 'unexpected. The constant misrepresentation of the facts in this situation is harmful for those ostensibly wanting to do good. "This is why understanding who raised these concerns is important." Since there was no roadblock - this answer makes no sense. The answer more likely that the researcher wanted a named list of what she perceived to be as her personal enemies. "Failing to cite some recent research is rarely grounds for rejection." There doesn't seem to be any reasonable cause for major concern in this whole issue - it seems the company raised some points and she could have managed them reasonably in professional terms.
- UncleMeat 6y agoI’ve personally submitted papers for this form of review on the same timeline that she did. No problems. So no, I don’t consider the method by which her paper was rejected to be normal practice.
- kps 6y ago> at the last second It was only ‘at the last second’ because Gebru chose not to follow the normal procedure. If the paper genuinely can't be ready until one day before the external deadline, the right thing to do is engage with the reviewers in advance, explain the problem, and provide them with drafts and work in progress, so that they can complete their work a few hours after yours. What Gebru did is the equivalent of bypassing code review and pushing to prod on Friday afternoon.
- Aeolun 6y agoThe top comment seems to imply that that was/is SOP.
- jolux 6y agoAccording to Jeff Dean's account of events, yes. According to nearly everyone else's, this process was unusual in that it even involved reviewing for content and not just IP, and Gebru herself says that the website about the process says to submit at least 1 week before publication, not two.
- jariel 6y ago"According to nearly everyone else's, this process was unusual in that it even involved reviewing for content and not just IP" This is ethics for Google's AI+Search which is currently undergoing global scrutiny, particularly by Congress and specific politicians who are considering anti-trust measures against Google - and who believe that 'their political party is being treated unfairly'. It's existential concern for them right now, relating to the possible breakup of the company. Every public communication on 'ethics' or search results etc. at Google is obviously going to have to be reviewed. If you're publishing the latest thing on 'AI Random Number Generation' obviously nobody cares about anything other than IP. The fact is, she must have known this and submitted anyhow - which is in and of itself not so bad, but that there was calamity afterwards ... there is no excuse. Google was absolutely reasonable - they did not ask to change the nature of the research, but wanted to make sure that information about new, better processes were included. It's beyond gracious for Google to do this, when really their starting point is 'silence' and they really don't have to do anything at all. A request for a fairly short review with very basic and reasonable concerns blew up. This is not a public university, you don't get perfectly tenured academic freedom, if Google wants to put a reasonable subnote in there - and take 2 weeks to do it, it's perfectly fine. Obviously Google would have kept her if they wanted to, but it's clear they were both looking for a way to part ways and it's probably for the better.