3 ms·
pp is prompt processing how fast it processes the prompt. Tg is token generation how fast, it generates tokens.
by throwawayffffas 1mo ago
pp is prompt processing how fast it processes the prompt. Tg is token generation how fast, it generates tokens.
- ascii0eks84 1mo agookay, so prefill and decode would be the terms I was already familiar with.