3 ms·
That is a problem readily solved by serial testing. False positive rate is reduced exponentially by the number of tests. >For a test to be useful, you need a h
by s1artibartfast 4y ago
That is a problem readily solved by serial testing. False positive rate is reduced exponentially by the number of tests.
>For a test to be useful, you need a hypothesis before you administer a test.
Hypothesis: some people get cancer
- deleted 4y ago[deleted]
- pclmulqdq 4y agoSerial testing only solves the problem if the tests are independent. With complicated medical tests, they often are not independent - for example, you can have a genetic factor that makes you reliably test positive for certain cancers. Note that COVID tests were generally independent (although not completely). If you want to flood hospitals with false positives that sounds like a good hypothesis. Then the people who actually do have cancer will not be taken seriously. Here's an example: Suppose you test for a cancer that is very common, and 1 in 10000 people have it. Also, suppose you have a very accurate test with a 5% false positive rate and a 5% false negative rate, and those false positives are sticky. If you 10000 people the test every week, 501 of them will reliably report positive. Every one of them will then report to the hospital with the cancer. Now the hospital has to deal with finding the one true positive before injecting people with literal poison to get rid of that cancer (chemotherapy). Since the hypothesis is "some people get cancer," you will find all of them! And you will find a shit load more of them who do not. Compare that to today, when your doctor says "you have a small lump in your body, let's test you for cancer" - that 5% false positive rate will mean very few false positives, so a positive cancer test means that you are ready for invasive treatment. Data is not information. You need information to make decisions. "Serial testing" only gets you data. That's why we only do it with "informational" tests like the Chem 20 and the CBC.
- thaumasiotes 4y ago> That is a problem readily solved by serial testing. False positive rate is reduced exponentially by the number of tests. This depends. There are two ways a test might deliver the wrong result: (A) It should have delivered the right result, but somewhere along the line something happened the wrong way. (B) The test correctly assessed the instrumental variable, but -- in this subject -- the instrumental variable did not reflect the variable of interest in the manner that it usually does. That is, many medical tests are not actually testing for the outcome we care about. They're testing for something that is usually related to the outcome we care about, because we don't know how to test for the real thing, or we do know how but the reliable test is far more invasive, or some such. There is a very accessible example of this kind of thing right now - you can take a sample from someone and test for the presence of covid. Or you can test for the presence of covid antibodies. Those variables are related, but different, and we care about the presence of the virus a lot more than we care about the presence of antibodies. If the test is failing in way (B), retests will not reduce the false positive rate, because it's actually a true positive that is being misinterpreted. Retesting will only solve failures of type (A). For type (B), you'd have to apply a different kind of test, and that might not be worth it if the first test is unreliable enough. Imagine an unreliable test where the reliable followup requires a bone marrow sample.