2 ms·
So ideally it could work like a meta-study. Meta-studies combine results from multiple separate studies, making correlations and drawing more confident conclu
by visarga 6y ago
So ideally it could work like a meta-study. Meta-studies
combine results from multiple separate studies, making correlations and drawing more confident conclusions. Most 'original' human ideas are just reinventions of older ideas, too.
The interesting part is that GPT-3's leap in performance can be attributed to scaling. That's easier to do than inventing completely new approaches. Scale data, scale compute, scale money, then you have something you couldn't have invented directly.