3 ms·
The author is actually claiming something more serious than the title suggests: "...all the concerns added together cast reasonable doubts about the current sci
by mannykannot 9y ago
The author is actually claiming something more serious than the title suggests: "...all the concerns added together cast reasonable doubts about the current scientific validity of the main claims."
To me, what follows does not seem to justify this claim, but it is not my field. In addition, some of his arguments seem to be beside the point - for example, he asks "Does AlphaZero completely learn from self-play?", and while saying generally, yes, he objects that encoding the rules was a non-trivial matter. While that certainly seems to be true, it does not seem to have much bearing on the claim that AlphaZero apparently learned to win through self-play. That, to me, seems to be its singular achievement: the absence of human-written tactics and strategy (unless the encoding of the rules somehow prefigured them, which is not being claimed here, and which seems highly unlikely.)
- YeGoblynQueenne 9y agoAs many others have pointed out, self-play in adversarial AI goes back to TD Gammon, in 1992. The fact alone that DeepMind is making such a big todo about self-play is a bit iffy in and of itself. It's probably a sign that they're more interested in catching the attention of the popular press and the general public, than of anyone who has at least read through Russel and Norvig [i.e. a popular AI textbook that mentions TD Gammon (in the Adversarial Search chapter)]. In any case- that's a claim in the paper and it's just as valid to scrutinise it as any other claim. But even more so if it's repeated in the lay press without anyone bothering to do their homework... Btw, if I may be a bit nosy- what is your field?
- mannykannot 9y agoTo a typical insurance salesman, the fact that self-play has been around for a while raises the question of why not until now, for chess? Maybe self-play in chess had already come within a whisker of this result? Has the state of the art reached the point where a bespoke self-play solution for any given chess/go -like game is now unremarkable? Is chess regarded as a sideshow that is given more attention than it deserves from the press and public? Even if this outcome is completely unremarkable from a technical point of view, the question remains, but as a social one. The author can certainly scrutinize whatever claims he likes, but does he make his case? I suppose he can certainly say that without further information, the outcome simply cannot be independently evaluated.