3 ms·
Yeah prompt processing is tokenizing the input, which includes the system prompt, chat history and your chat text. Generation is the response it sends back
by idonotknowwhy 3y ago
Yeah prompt processing is tokenizing the input, which includes the system prompt, chat history and your chat text.
Generation is the response it sends back