4 ms·
Has anyone got any good other references for this? After some of the dodgy experiments related to alpha zero (comparing to purposefully degraded chess systems),
by CJefferson 6y ago
Has anyone got any good other references for this? After some of the dodgy experiments related to alpha zero (comparing to purposefully degraded chess systems), I'd love to see some independent analysis.
- sanxiyn 6y agoCASP is that independent analysis...
- CJefferson 6y agoTrue, but I haven't seen an independent discussion of the CASP results. There is a good chance this is great, but I don't trust deepmind press releases.
- andi999 6y agoI am also wondering. I generally find these kind of approaches hard to believe, but this might be my prejudices.
- syncsynchalt 6y agoThe article in Science implies that we have independent confirmation of predictions yielding useful results, beyond the challenge itself: > The organizers even worried DeepMind may have been cheating somehow. So Lupas set a special challenge: a membrane protein from a species of archaea, an ancient group of microbes. For 10 years, his research team tried every trick in the book to get an x-ray crystal structure of the protein. “We couldn’t solve it.” > But AlphaFold had no trouble. It returned a detailed image of a three-part protein with two long helical arms in the middle. The model enabled Lupas and his colleagues to make sense of their x-ray data; within half an hour, they had fit their experimental results to AlphaFold’s predicted structure. “It’s almost perfect,” Lupas says. “They could not possibly have cheated on this. I don’t know how they do it.”
- CJefferson 6y agoThanks, that really is convincing.
- gamegoblin 6y agoThe "dodgy experiments" (setting the per-turn computation time to a fixed value) in the chess system were only in the pre-print. In the actual publication, they allowed for full time control of the most up-to-date version of stockfish.
- CJefferson 6y agoI will admit I may not have kept up to date. Did they also restore the opening and endings, and use the latest Stockfish?
- gamegoblin 6y agoYes, and then Leela Chess Zero, an open source implementation of AlphaZero, beat the latest Stockfish in the de facto engine championship (TCEC). Since AlphaZero, the TCEC finals have been traded back and forth between Stockfish and LCZero. This last season, Stockfish won by using NNUE, a neural network based evaluation function. https://en.wikipedia.org/wiki/Top_Chess_Engine_Championship#Tournament_results_(TCEC) https://en.wikipedia.org/wiki/Top_Chess_Engine_Championship#...