3 ms·
He really elides his thoughts on the "RSI business", wish he could have gone into a bit more depth there. Good post, though.
by 1986 18d ago
He really elides his thoughts on the "RSI business", wish he could have gone into a bit more depth there. Good post, though.
- einrealist 18d agoCan't imagine that RSI will result in something useful in practice. There are serious obstacles like alignment drift and model collapse. All while we still cannot solve the accuracy problem with current frontier models.
- the_mitsuhiko 18d agoI really don't know anything here, but I'm assuming that Astra's weird coding [1] is probably more a result of RSI than intentional behavior. And if it's not, then it's some other change in their training process. [1]: https://lucumr.pocoo.org/2026/9/7/astra-why/ https://lucumr.pocoo.org/2026/9/7/astra-why/