3 ms·
The model only predicts the next token. This is appended to the original input (i.e. prompt), then the model predicts the next token again, etc. So those previo
by wcoenen 4y ago
The model only predicts the next token. This is appended to the original input (i.e. prompt), then the model predicts the next token again, etc. So those previous answers are given as input.