2 ms·
Does anyone think the results are a little suspect? They don't do human evaluations of which people would prefer, and instead say that because the MAUVE metric
by tangjurine 3y ago
Does anyone think the results are a little suspect?
They don't do human evaluations of which people would prefer, and instead say that because the MAUVE metric is better with their training method, that the model is better.
- lucubratory 3y agoThere is a lot of daylight between "They didn't expend significant resources on making their study more informative and comprehensive" and "These results are suspect". Those are not the same thing. MOS are reasonably expensive for this type of research and are by no means an accepted minimum.