3 ms·

> Recomputing the AlphaGo Zero weights will take about 1700 years on commodity hardware We're seeing the reversal of PC revolution and most people don't seem t

> Recomputing the AlphaGo Zero weights will take about 1700 years on commodity hardware We're seeing the reversal of PC revolution and most people don't seem to notice or care.

deleted 9y ago
[deleted]
dragontamer 9y ago
On the contrary. Google achieved such high computational power from building custom chips. No one in the 90s could have afforded the custom ASICs that ran "Deep Blue", and certainly no one except Disney in the 90s could afford the giant cluster of computers used to compute "Toy Story". The story of "PC Revolution" is always Big Company spends billions on custom ASICs -> hardware companies take notice -> NVidia releases "Volta" which emulates the TPU in 2018. (https://devblogs.nvidia.com/parallelforall/inside-volta/ https://devblogs.nvidia.com/parallelforall/inside-volta/) Soooo yeah. We're actually really, really close to consumer-level TPUs. Within a year or two. Google's secret sauce is being replicated by hardware companies now, and consumers will likely reap the rewards. There's always a few years of delay between state-of-the-art custom machines and wide-spread adoption of consumer hardware. ----------- Despite their success in these games, I'm personally not really sold on the broad applicability of Neural Networks. But hey, I'm willing to be proven wrong. There's a lot of experimentation being done and the "TPU" architecture is definitely very interesting (and the way "Tensors" map to simple linear-algebra problems is really what makes all of this possible). I really wouldn't be too gloomy about Google's headstart. They did invent the TPU architecture after all, its only fair that they get to play with it for a few years before the mass market consumers can.
- SomeHacker44 9y ago
  I could swear Toy Story was a Pixar production long before it was Disney...

3 ms·

> Recomputing the AlphaGo Zero weights will take about 1700 years on commodity hardware We're seeing the reversal of PC revolution and most people don't seem t

by romaniv 9y ago

> Recomputing the AlphaGo Zero weights will take about 1700 years on commodity hardware We're seeing the reversal of PC revolution and most people don't seem to notice or care.

deleted 9y ago
[deleted]
dragontamer 9y ago
On the contrary. Google achieved such high computational power from building custom chips. No one in the 90s could have afforded the custom ASICs that ran "Deep Blue", and certainly no one except Disney in the 90s could afford the giant cluster of computers used to compute "Toy Story". The story of "PC Revolution" is always Big Company spends billions on custom ASICs -> hardware companies take notice -> NVidia releases "Volta" which emulates the TPU in 2018. (https://devblogs.nvidia.com/parallelforall/inside-volta/ https://devblogs.nvidia.com/parallelforall/inside-volta/) Soooo yeah. We're actually really, really close to consumer-level TPUs. Within a year or two. Google's secret sauce is being replicated by hardware companies now, and consumers will likely reap the rewards. There's always a few years of delay between state-of-the-art custom machines and wide-spread adoption of consumer hardware. ----------- Despite their success in these games, I'm personally not really sold on the broad applicability of Neural Networks. But hey, I'm willing to be proven wrong. There's a lot of experimentation being done and the "TPU" architecture is definitely very interesting (and the way "Tensors" map to simple linear-algebra problems is really what makes all of this possible). I really wouldn't be too gloomy about Google's headstart. They did invent the TPU architecture after all, its only fair that they get to play with it for a few years before the mass market consumers can.
- SomeHacker44 9y ago
  I could swear Toy Story was a Pixar production long before it was Disney...