3 ms·
It's actually not linear, its a power law. That means we need exponentially more compute, data, and model parameters to see linear improvements in performance.
by bcaine 5y ago
It's actually not linear, its a power law. That means we need exponentially more compute, data, and model parameters to see linear improvements in performance.