3 ms·
No, almost all the progress is driven by bigger GPUs and datasets. To be fair, things like CNN's and BERT were definitely massive improvements, but a lot of mo
by disgruntledphd2 6y ago
No, almost all the progress is driven by bigger GPUs and datasets.
To be fair, things like CNN's and BERT were definitely massive improvements, but a lot of modern AI is just throwing compute at problems and seeing what sticks.