4 ms·
His point that the test as described - with multiple statistical issues piled on top of each other - does not allow much of a meaningful inference in any direct
by t_mann 4y ago
His point that the test as described - with multiple statistical issues piled on top of each other - does not allow much of a meaningful inference in any direction is completely valid and independent of what hypotheses were being tested.
- ravi-delia 4y agoSure, but the terms of the bet were known ahead of time. Like, Alexander never claimed composition was solved, just that he won the bet. Which he did.
- t_mann 4y agoEven more so it is appropriate to point out that this victory is strictly limited to the specific terms of this particular bet (and strictly speaking not even that, since the terms were changed after the bet was placed), and do not provide statistically sound evidence of progress on compositionality. PS: in the end, Alexander claims that his experiment "provide(s) some evidence that simple scaling and normal progress are enough for compositionality gains". So he does in fact go significantly beyond just claiming victory on this particular bet.