3 ms·
Did Deep Mind get that from reading a bunch of papers, though? Or did it get it from having those rules and facts programmed into it? (The original claim was
by AnimalMuppet 4y ago
Did Deep Mind get that from reading a bunch of papers, though? Or did it get it from having those rules and facts programmed into it? (The original claim was about the ability of AIs to extract the rules from the literature.)
But your last sentence... if it had the rules programmed in, shouldn't it have also programmed in the ability to name the rules? If it learned them from reading papers, shouldn't it know the terms from the papers? Or is the problem that it doesn't have at all the ability to trace out the chain it used to reach the conclusion? Is the problem not so much expressing the chain as much as it is knowing the chain?
- walnutclosefarm 4y agoYou raise good questions. I'm mixing two different types of models to make a point from two different directions. Each has it's own and different limitations. Deep Mind Alpha Fold did not get the rules from reading papers. It uses a combination of learned (from being trained on known protein structures) prediction of structure, and iterative application of learned refinement, constrained by physical and chemical rules. So, some of the knowledge required is "programmed in" as you suggest, but most has been learned by the algorithm through training on known structures. My point was that the result is nevertheless a workable effective procedure for predicting protein structures. The other system that I referred to did learn from reading literature. It is a fundamentally different AI architecture (a variant of transformer architecture for large language models). It has no physical knowledge programmed in.