5 ms·
There are too many details missing for the results to be reproducible. Does it even qualify as a tech demo if the result only exists in DeepMind's lab?
by gcp 9y ago
There are too many details missing for the results to be reproducible.
Does it even qualify as a tech demo if the result only exists in DeepMind's lab?
- bawana 9y agoThis raises an interesting concept. If you cannot reproduce an experiment because of lack of resources, can you believe it? Or is this the equivalent of 'photoshopping your results'? A similar problem exists in cosmology. Can you verify the multiverse model if you only have one universe to experiment in? As data storage requirements in RAM and TPU power requirements increase to run certain models/algorithms, machine learning is becoming more obscure. Not only can we not understand how an AI is reaching its conclusions (inscrutability), we cannot even probe it (by tweaking parameters, etc) to find weak points (inaccesibility). This is actually a good thing. Where humans cannot tread, there can be no evil?
- gcp 9y agoAt least in computer chess such experiments were typically demonstrated by winning the World Championship. (And sometimes they failed...cough Deep Blue cough)