4 ms·

Their use of an external validation dataset eliminates many, if not all, of those concerns. Regarding external validation set: > This dataset differed from th

Their use of an external validation dataset eliminates many, if not all, of those concerns. Regarding external validation set: > This dataset differed from the UK Biobank development set with respect to both fundus camera used, and in sourcing from a pathology-rich population at a tertiary ophthalmic referral center. Regarding UK Biobank set (training set) > UK Biobank dataset, which is an observational study in the United Kingdom that began in 2006 and has recruited over 500,000 participants—85,262 of which received eye imaging38. Eye imaging was obtained at 6 centers in the UK and comprises over 10 terabytes of data39. Participants volunteered to provide data including other medical imaging, laboratory results, and detailed subjective questionnaires.

nerdponx 5y ago
Still, until we have a better sense of what features the model is extracting, it's a surprising result and ought to be treated with caution.
- slver 5y ago
  I wish we treated our own conclusions this way.
  - ithkuil 5y ago
    Science's secret weapon is the innate pleasure that many academics have in proving their colleagues wrong.
    - raihansaputra 5y ago
      That same spirit is also what's behind shorts in the market to keep overly optimistic players in check. As with crypto-ransom operations against corporations to keep their system security on alert. Adversarial actions (within reasonable boundaries) is the most important balance mechanism.
      - slver 5y ago
        The problem is keeping the adversaries balanced. Otherwise you have one side overpowering everything (and typically not through the "correctness" of their argument, but scale and resources) and the adversarial system becomes detrimental to progress.
    - slver 5y ago
      Unfortunately that also results in them trying to prove their colleagues are wrong about other of their colleagues being wrong. So the bottom line is that ironically due to this science gets stuck on false beliefs and they can be a bit hard to dislodge. We have even this principle: https://en.wikipedia.org/wiki/Planck%27s_principle https://en.wikipedia.org/wiki/Planck%27s_principle

nerdponx 5y ago

Still, until we have a better sense of what features the model is extracting, it's a surprising result and ought to be treated with caution.

slver 5y ago
I wish we treated our own conclusions this way.
- ithkuil 5y ago
  Science's secret weapon is the innate pleasure that many academics have in proving their colleagues wrong.
  - raihansaputra 5y ago
    That same spirit is also what's behind shorts in the market to keep overly optimistic players in check. As with crypto-ransom operations against corporations to keep their system security on alert. Adversarial actions (within reasonable boundaries) is the most important balance mechanism.
    - slver 5y ago
      The problem is keeping the adversaries balanced. Otherwise you have one side overpowering everything (and typically not through the "correctness" of their argument, but scale and resources) and the adversarial system becomes detrimental to progress.
  - slver 5y ago
    Unfortunately that also results in them trying to prove their colleagues are wrong about other of their colleagues being wrong. So the bottom line is that ironically due to this science gets stuck on false beliefs and they can be a bit hard to dislodge. We have even this principle: https://en.wikipedia.org/wiki/Planck%27s_principle https://en.wikipedia.org/wiki/Planck%27s_principle