4 ms·
Model collapse If you solve it then yes humans are toast mental usefulness wise
by johnsmith1840 11d ago
Model collapse
If you solve it then yes humans are toast mental usefulness wise
- ChickeNES 11d agoModel collapse as an insurmountable wall is a fiction dreamed up by Luddites, actual frontier labs understand the failure mode and avoid it.
- johnsmith1840 10d agoNobody can avoid it. You can RL things in a box until the box is mapped perfectly but that doesn't mean you can go forever on out of distribution data. Our number of boxes will increase but model collapse is an open problem. Astra goes farther than any model before but it cannot go forever.
- int_19h 11d agoModels have been trained on synthetic inputs for over a year now. Collapse only happens in very specific circumstances, it's not a limit in practice.
- johnsmith1840 10d agoYeah, that's why fully autonomous robots are so easy to train on novel tasks. Or why figure is strapping cameras to human workers for cleaning. Sythetic data works in a bounded box we have mapped you can't just make up novel data and it works. Model collapse is completely unsolved.