4 ms·
This amounts to a cost-saving measure - you can generate arbitrarily many tokens by appending the output and re-invoking the model.
by thegeomaster 2y ago
This amounts to a cost-saving measure - you can generate arbitrarily many tokens by appending the output and re-invoking the model.