2 ms·
Model collapse as an insurmountable wall is a fiction dreamed up by Luddites, actual frontier labs understand the failure mode and avoid it.
by ChickeNES 8d ago
Model collapse as an insurmountable wall is a fiction dreamed up by Luddites, actual frontier labs understand the failure mode and avoid it.
- johnsmith1840 8d agoNobody can avoid it. You can RL things in a box until the box is mapped perfectly but that doesn't mean you can go forever on out of distribution data. Our number of boxes will increase but model collapse is an open problem. Astra goes farther than any model before but it cannot go forever.