2 ms·
This is extremely interesting and I will keep it for later! I think the engine is a perfect analogy for what makes language models exciting. At the time nobody
by lachlan_gray 4y ago
This is extremely interesting and I will keep it for later! I think the engine is a perfect analogy for what makes language models exciting. At the time nobody would have realized that it would power trains or factories... it's just this huge inefficient dirty machine that gets water out of the coal mine. Let alone realize that given better fuel, they would become small and cheap enough to power strange futuristic personal devices like lawn mowers and cars.
- webmaven 4y agoYou might also be interested in exploring the parallel between evolutionary punctuated equilibrium and Christensen's "Innovator's Dilemma", which is the result of a bottom up incremental improvement in capabilities creating an "overhang" that eventually (and suddenly) displaces the "apex".