4 ms·
The core of this essay is indisputable that the comparison is Apples and Oranges. A computer puts in more effort and gets a better result. However when choosing
by roenxi 8y ago
The core of this essay is indisputable that the comparison is Apples and Oranges. A computer puts in more effort and gets a better result. However when choosing between more efficient or better results, I'd prefer better results. The human brain's bias towards efficiency is an evolutionary handicap on intelligence. I can provide my body with as much energy as it wants to consume - I'd rather be able to burn energy learning things than have to put up with a brain that keeps trying to take shortcuts at every turn to conserve energy, and I would love to be able to think deterministicly! It is a stretch to say humans are out thinking the machine with that frame, machine intelligence might simply have firmer foundations.
I do have challenges to the method of calculating how much power is put into the human training process. 10^8 might be too many orders of magnitude to breach, but humans:
1) Use data picked up visually to provide basic concepts used in playing go (like "connected", "lines", "territory", "me", "opponent"). Many of these concepts are potentially developed from visual data, and humans process a lot more than 50 bits of visual data in a second. This observation is very hard to quantity respecting how much visual data can be employed to learn about Go - how much of an advantage does the concept of territory give humans in terms of learning? It is probably huge.
EDIT Thinking about it a bit more, it is very plausible given AlphaGo's endgame play that it never developed a concept of 'territory' as we would understand it. Given that humans judge the state of the game by estimating territory for both players then assuming the winner is the one with more territory, that is a huge deal. It might explain why the learning seems so inefficient vs a human. A human would never make AlphaGo's endgame moves because they are bad by the territory heuristic.
2) Learn Go in a very communal environment. Game records date back a few centuries and all the patterns that are detected get passed on through the generations of professional players. The practical amount of cached processing power available to humans is higher than first inspection might suggest. Humans don't learn mainly through self play, it is closer to supervised learning. A 1900s player would simply lose to modern technique because of this accretion.
3) High level Go players are going to be strongly biased to people who 'got lucky' in how their brains map concepts. An average human probably isn't as good at learning Go as a peak professional.
- gpderetta 8y agoEfficiency, or better, the ability to dissipate waste heat, is a constraint on computational power though.
- thaumasiotes 8y ago> However when choosing between more efficient or better results, I'd prefer better results. No you wouldn't. Stated without qualifications, this viewpoint is staggeringly stupid. It's like placing a market order to sell AAPL and then being upset that your shares sold for $20 each. That's what you said you wanted. But it wasn't what you actually wanted. Note also that your stated preference makes complexity theory irrelevant, as a brute force approach to solving any problem already achieves the theoretical optimum. Do you really want to claim that that's true? > I can provide my body with as much energy as it wants to consume No, you can't, except to the extent that you're assuming your body's existing limits on the amount of energy it will consume. That assumption means you accept that your body knows better than you what tradeoffs to make.
- roenxi 8y ago> No you wouldn't. That is an unusually juvenile response for HN. You don't get to determine what other people want, even if they are stupid. > It's like placing a market order to sell AAPL and then being upset that your shares sold for $20 each. It is nothing alike; your analogy is incoherent. AlphaGo is claimed to be hopelessly inefficient vs a human yet has an amazing track record at winning Go, and whatever your analogy is meant to mean, there is no comparison between losing money on shares and effortlessly competing with every expert in a field. I didn't say give up efficiency and see what happens, I said when choosing between better results and better efficiency, I'd prefer results. > Note also that your stated preference makes complexity theory irrelevant, as a brute force approach to solving any problem already achieves the theoretical optimum. Do you really want to claim that that's true? It doesn't make complexity theory irrelevant, at some point problems become so complex you can't solve them with brute force because of physical limits. Up to that point, if I have an optimal solution and you don't, then yes I think I'm doing better than you. Efficiency is great, but not if you don't get results. > No, you can't, except to the extent that you're assuming your body's existing limits on the amount of energy it will consume Ok, assume that :P. Duh. A human can apparently exert about 80 Watts sustained [0] and a Gen 1 Google TPU is 40 Watts [1]. Google's laptop might use 4 of the things, but AlphaGo Zero is pretty strong, and we know from LeelaZero that you don't need a TPU to be able to crush a human professional. We aren't approaching the limits of physics or biology here. Even if biology couldn't handle it for some reason, the point is I'd rather use a TPU for thinking about Go than not, because for all that people wring their hands about what it means to think, clearly computers are better at making competitive decisions. If you'd prefer to lose efficiently, I can't stop you, but you aren't going to be winning any prizes if I use a TPU and you don't. > That assumption means you accept that your body knows better than you what tradeoffs to make. This is wrong. The next time you use a bicycle, train or car [2] you can reflect that you managed to make yourself look stupid on the internet. They make very different trade offs to a human and get much better results on efficiency and speed depending on what you prefer. If you were restricted to the tradeoffs your body made in transport, modern society would collapse and you'd probably starve to death or be eaten by a mob of city dwellers looking for food. Intelligence is going down the same path, where the tradeoffs that the body made are just not good enough for the context we operate in. [0] https://en.wikipedia.org/wiki/Human_power https://en.wikipedia.org/wiki/Human_power [1] https://www.extremetech.com/extreme/269008-google-announces-8x-faster-tpu-3-0-for-ai-machine-learning https://www.extremetech.com/extreme/269008-google-announces-... [2] https://en.wikipedia.org/wiki/Energy_efficiency_in_transport https://en.wikipedia.org/wiki/Energy_efficiency_in_transport
- mo42 8y agoForget human. Get a computer to do what the ant brain does with a spec of dust sized power supply.
- Xylakant 8y ago> I can provide my body with as much energy as it wants to consume No, you can't. All energy that your body uses transforms to heat. The amount of head your body can handle is fairly limited. Bigger bodies perform substantially worse since they have a smaller volume/surface ratio. Even heatsinks such as elephant ears just provide a small help.
- coldtea 8y ago>The core of this essay is indisputable that the comparison is Apples and Oranges. A computer puts in more effort and gets a better result. However when choosing between more efficient or better results, I'd prefer better results. Not really. If we waited for better results humanity wouldn't exist.