2 ms·
That’s not happening in run time, when you send the prompts for the next token to be generated. The comment seems to imply a run time phenomenon.
by geraneum 9mo ago
That’s not happening in run time, when you send the prompts for the next token to be generated. The comment seems to imply a run time phenomenon.