3 ms·
It's a nice sentiment, but it's not always true. Case in point: none of the algorithmic improvements to matrix-multiplication has had any real effect on deep-l
by thwero234234 6y ago
It's a nice sentiment, but it's not always true.
Case in point: none of the algorithmic improvements to matrix-multiplication has had any real effect on deep-learning etc (except Winograd convolution).
- andrewem 6y agoThere’s this example of your point, which claims that “Compiler Advances Double Computing Power Every 18 Years” http://proebsting.cs.arizona.edu/law.html http://proebsting.cs.arizona.edu/law.html
- GeorgeIsRight 6y agoAlexnet software has improved 44x in past 8 years, hardware something like 11x. https://openai.com/blog/ai-and-efficiency/ https://openai.com/blog/ai-and-efficiency/