2 ms·
What are pp/tg? I get 30t/s on 27B qwen.
by ascii0eks84 1mo ago
What are pp/tg? I get 30t/s on 27B qwen.
- throwawayffffas 1mo agopp is prompt processing how fast it processes the prompt. Tg is token generation how fast, it generates tokens.
- ascii0eks84 27d agookay, so prefill and decode would be the terms I was already familiar with.