4 ms·
But computers get faster each year, so even with zero progress in actual AI, this will reach human-student speeds in a few years (need a 40x speed up)
by acchow 2y ago
But computers get faster each year, so even with zero progress in actual AI, this will reach human-student speeds in a few years (need a 40x speed up)
- awesomeMilou 2y agoCould you explain where the 40x speedup comes from, given that literally the biggest problem in semi conductors right now is smaller node size?
- cma 2y agoJust bigger chip area at lower clock could do it too if there is no threshold on cost anyway and they were limited by power. Google would hit enough accumulated production of AI chip area and cluster build out even if Moore's law stopped. There will likely be big algorithmic improvments too.
- lupire 2y agoImproved parallelization. More cost in less time. This is Nvidia's main area of research now.
- knotthebest 2y agoStill, very marginal improvements. There is also Amdahl’s Law which limits the speed gains of parallelisation.