10 ms·
The algorithmic approach has the potential to offer greater transparency, but not if the algorithm isn't published. This isn't really true. There's actually a
by yummyfajitas 10y ago
The algorithmic approach has the potential to offer greater transparency, but not if the algorithm isn't published.
This isn't really true. There's actually a mathematical discipline devoted to treating statistical algorithms as black boxes, and assessing their accuracy/generalizability based solely on test data/broad intrinsic properties of the algorithm (e.g. continuity parameters).
It's called "machine learning".
From what I can tell, the fundamental distinction between machine learning and statistics is that machine learning provides mathematical guarantees based solely on black box testing of algorithms and very broad properties of the distribution/algo. In contrast, statistics cares about the actual underlying process.
- superbatfish 10y agoGreat points. It's true that whatever algorithm they end up with will definitely use ML. And it's also true that "interpretability" is one of the great challenges for ML in the coming years. But interpretability of a model isn't a binary attribute. Some techniques offer at least some intuition about why they chose their results. But a human editor, on the other hand, is much less transparent -- basically, the best justification they can offer is "trust me, I know what I'm doing".