4 ms·
This is very fascinating, so thank you for looking into this. I think you may have misunderstood the rating system. You said >>>Let’s say I really have to prod
by gabrielgoh 9y ago
This is very fascinating, so thank you for looking into this. I think you may have misunderstood the rating system. You said
>>>Let’s say I really have to produce a rating, though. What would I do? I would probably:
- Find some experts and ask them to assign weights to my various measures on the basis of how much they contribute to quality
But isn't this is exactly what the latent variable model (really a PCA) is doing? The only difference is - rather than have experts pick 60 weights for each component, which would require 60 contentious decisions, the PCA does some form of dimensional reduction so the experts need only pick weights for 7 components, which "unravel" into 60 weights. This sounds reasonable to me - assuming of course, the PCA components each have meaningful interpretations, and measure the degree of "good".
- bbayles 9y agoI admire your charitable interpretation. I'd be fine with the rating system using automation to reduce the number of subjective decisions to be made - I thought the LVM approach was a good one when I first heard about it. As the second article points out, even this is kind of crazy, and the implementors didn't seem to care at all about what the results were - for example, the imaging category is driven by a single measure related to abdominal CT scans.
- Govindae 9y ago>This sounds reasonable to me - assuming of course, the PCA components each have meaningful interpretations, and measure the degree of "good". But they won't, unless it happens to project near one of your dimensions. If the 7 components can only be understood as linear combinations of 60 factors, your experts still need to provide 60 scores.