4 ms·
ask it to consider what it just wrote
by mavhc 3y ago
ask it to consider what it just wrote
- jebarker 3y agoRight. I think we'll end up seeing models that iterate on larger parts of autoregressive generations before presenting them to the user. It's just more compute, i.e. the bitter lesson.