3 ms·
Weird take, but OK... BERT was arguably the real breakthrough moment, where everything started working.
by hiddencost 4y ago
Weird take, but OK... BERT was arguably the real breakthrough moment, where everything started working.
- tooltitude 4y agoI would say that BERT was an incremental improvement (as well as many others). But the idea of much more efficient sequence processing was introduced in this exact paper.