2 ms·
That's just an implementation artifact and not a fundamental fact of life. https://docs.vllm.ai/en/latest/features/batch_invariance/ https://docs.vllm.ai/en/la
by omneity 9mo ago
That's just an implementation artifact and not a fundamental fact of life.
https://docs.vllm.ai/en/latest/features/batch_invariance/ https://docs.vllm.ai/en/latest/features/batch_invariance/