4 ms·

I've seen these review comments before and I don't know if we can say from our position whether it's corrections that can be made for camera ready or not. If a

I've seen these review comments before and I don't know if we can say from our position whether it's corrections that can be made for camera ready or not. If a paper does not analyze the improvements from recent work, and just older work that has been surpassed (deemed inefficient by Dean), the new reanalysis might not be as favorable to the results as the paper proposes which means the paper is moot. Or the second point is about bias in language models, but it sounds like these issues are mitigated in recent research, which means people are already aware and have solved a bulk of the issue being described in the paper. But certainly it's possible that the paper's contributions stands strong even after accounting for the recent work that Dean mentions. In that case, it could be corrected for camera ready. But my point is that we can't tell right now without seeing the paper, and the relevant research that was omitted.

whimsicalism 6y ago
But this review process had never been used for introducing comments of this sort to a paper ever before. Plus, there was no suggestion of change, just retraction.
- lokar 6y ago
  > But this review process had never been used for introducing comments of this sort to a paper ever before How do you know that?
  - pseudalopex 6y ago
    "My submissions were always checked for disclosure of sensitive material, never for the quality of the literature review."[1] "In all of my time at Google AI, I never heard of pubapproval being used for peer review or to critique the scientific rigor of the work. It was never used as a journal, it was an afterthought that folks on my team would usually clear only hours before important deadlines. We like to leave peer review to the conferences/journals' existing process to weed out bad papers; why duplicate that work internally?"[2] [1] https://twitter.com/le_roux_nicolas/status/1334601960972906496 https://twitter.com/le_roux_nicolas/status/13346019609729064... [2] https://news.ycombinator.com/item?id=25307456 https://news.ycombinator.com/item?id=25307456
    - lokar 6y ago
      Huh. When I was there I certainly saw review for quality / novel ideas.

whimsicalism 6y ago

But this review process had never been used for introducing comments of this sort to a paper ever before. Plus, there was no suggestion of change, just retraction.

lokar 6y ago
> But this review process had never been used for introducing comments of this sort to a paper ever before How do you know that?
- pseudalopex 6y ago
  "My submissions were always checked for disclosure of sensitive material, never for the quality of the literature review."[1] "In all of my time at Google AI, I never heard of pubapproval being used for peer review or to critique the scientific rigor of the work. It was never used as a journal, it was an afterthought that folks on my team would usually clear only hours before important deadlines. We like to leave peer review to the conferences/journals' existing process to weed out bad papers; why duplicate that work internally?"[2] [1] https://twitter.com/le_roux_nicolas/status/1334601960972906496 https://twitter.com/le_roux_nicolas/status/13346019609729064... [2] https://news.ycombinator.com/item?id=25307456 https://news.ycombinator.com/item?id=25307456
  - lokar 6y ago
    Huh. When I was there I certainly saw review for quality / novel ideas.