4 ms·
I thought I saw some paper suggesting that accuracy grows linearly with exponential data. If that's the case it's not a mystery why we'd be hitting a training w
by pton_xd 2y ago
I thought I saw some paper suggesting that accuracy grows linearly with exponential data. If that's the case it's not a mystery why we'd be hitting a training wall. Not sure I got the right takeaway from that study, though.
EDIT: here's the paper https://arxiv.org/abs/2404.04125 https://arxiv.org/abs/2404.04125