Sure for a fixed dataset, more training plateaus after a while. However with more power we can work on different types of data. For example instead of using 2

Sure for a fixed dataset, more training plateaus after a while. However with more power we can work on different types of data. For example instead of using 2D CNNs on images, we can now use 3D CNNs on high resolution pointcloud data. Also as the speed of data acquisition grows being able to train a given model on a given type and size of dataset to a fixed 'level' as fast as possible becomes even more important.