3 ms·
Right. I think we'll end up seeing models that iterate on larger parts of autoregressive generations before presenting them to the user. It's just more compute,
by jebarker 3y ago
Right. I think we'll end up seeing models that iterate on larger parts of autoregressive generations before presenting them to the user. It's just more compute, i.e. the bitter lesson.