3 ms·
It does but it also generalizes extremely well
by andoando 2y ago
It does but it also generalizes extremely well
- tripplyons 2y agoI haven't seen a convincing argument that it is more sample efficient than a neural network that has seen an equivalent amount of lifetime information. Yann LeCun gave an interesting explanation of how even in the first few years of a child's life, they have seen much more information than the largest pretrained models have.