3 ms·
It doesn’t appear to be token-by-token inference. Each new completion uses a different model, but the new completion is entirely created by that model.
by breckenedge 3y ago
It doesn’t appear to be token-by-token inference. Each new completion uses a different model, but the new completion is entirely created by that model.